-- Logs begin at Tue 2022-07-26 14:01:10 UTC, end at Tue 2022-07-26 15:44:15 UTC. -- Jul 26 15:10:19.713017 dv-osbrick-786732-11-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 15:10:19.721682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 15:10:19 2022] *** Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: nodename: dv-osbrick-786732-11-ceph Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: machine: x86_64 Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: clock source: unix Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: pcre jit disabled Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: detected number of CPU cores: 4 Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: current working directory: / Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: detected binary path: /usr/bin/uwsgi-core Jul 26 15:10:19.723682 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: your processes number limit is 47680 Jul 26 15:10:19.724400 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: your memory page size is 4096 bytes Jul 26 15:10:19.724400 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: detected max file descriptor number: 2048 Jul 26 15:10:19.724400 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: lock engine: pthread robust mutexes Jul 26 15:10:19.724400 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: thunder lock: enabled Jul 26 15:10:19.724400 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 15:10:19.724400 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 15:10:19.768699 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: Python main interpreter initialized at 0x5635dab779c0 Jul 26 15:10:19.768699 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: python threads support enabled Jul 26 15:10:19.768699 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: your server socket listen backlog is limited to 100 connections Jul 26 15:10:19.768699 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: your mercy for graceful operations on workers is 90 seconds Jul 26 15:10:19.769038 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 15:10:19.769038 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: *** Operational MODE: preforking *** Jul 26 15:10:19.769297 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: *** uWSGI is running in multiple interpreter mode *** Jul 26 15:10:19.769297 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: spawned uWSGI master process (pid: 87476) Jul 26 15:10:19.769505 dv-osbrick-786732-11-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 26 15:10:19.770901 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: spawned uWSGI worker 1 (pid: 87488, cores: 1) Jul 26 15:10:19.771011 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: spawned uWSGI worker 2 (pid: 87489, cores: 1) Jul 26 15:10:19.776140 dv-osbrick-786732-11-ceph devstack@keystone.service[87476]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 15:10:25.538249 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:10:25.538249 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: from cryptography.utils import int_from_bytes Jul 26 15:10:25.539006 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:10:25.539006 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: from cryptography.utils import int_from_bytes Jul 26 15:10:25.541130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:10:25.541130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: from cryptography.utils import int_from_bytes Jul 26 15:10:25.541626 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 15:10:25.541626 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: from cryptography.utils import int_from_bytes Jul 26 15:10:25.589577 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 15:10:25.589781 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 15:10:25.589974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] command line args: [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 15:10:25.590347 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 15:10:25.590569 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ================================================================================ {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 15:10:25.590821 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] admin_token = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.591075 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] config_dir = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.591263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.591444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 15:10:25.591534 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] config_source = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.591616 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] debug = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.591701 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 15:10:25.591806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.592056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] command line args: [] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 15:10:25.593303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 15:10:25.593393 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.593471 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ================================================================================ {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 15:10:25.593533 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.593598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] admin_token = **** {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.593662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.593726 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] config_dir = [] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.593790 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.593866 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.593933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.593997 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] config_source = [] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594061 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_config_append = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594119 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] debug = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_dir = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_file = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594576 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594705 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594764 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] list_limit = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.594957 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] log_config_append = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595142 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595268 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] log_dir = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595327 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595385 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] log_file = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595448 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595525 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595737 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595862 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.595968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.596090 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.596245 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.596341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.596470 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.596588 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.596674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.596834 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.596923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.597084 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.597177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.597324 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.597564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.597650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.100/identity {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.597754 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] publish_errors = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.598017 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.598209 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.598412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.598614 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.598801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.598915 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.599050 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.599164 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.599274 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.599412 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.599412 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] standard_threads = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.599412 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.599799 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.100/identity {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.599799 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] publish_errors = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.600054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.600292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.600431 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.600431 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] use_journal = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.600634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.600751 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] use_json = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.600905 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.601020 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] use_stderr = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.601163 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.601277 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] use_syslog = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.601386 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.601532 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.601638 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] standard_threads = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.601744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.601817 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.601924 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.602001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.602114 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.602200 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.602200 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] use_journal = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.602379 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.602992 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] use_json = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.603066 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.603145 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] use_stderr = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.603218 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.603289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] use_syslog = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.603363 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.603436 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 15:10:25.603505 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.603583 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.603762 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.603840 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.603916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.603997 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.604070 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.604170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.604246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.604321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.604398 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.604469 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.604539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.604619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.604767 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.604845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.605016 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.605100 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.605247 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.605322 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.605498 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.605578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.605754 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.605831 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.605999 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.606078 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.606235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.606318 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.606489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.606565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.606746 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.606832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.606992 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.607075 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.607238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.607320 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.607469 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.607548 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.607771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.607852 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.607930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.608002 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.608186 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.608281 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.608435 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.608519 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.608682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.608760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.608913 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.608991 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.609144 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.609255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.609391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.609470 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.609650 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.609728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.609971 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.610149 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.610227 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.610404 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.610484 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.610637 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.610713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.610872 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.610956 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.611110 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.611202 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.611329 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.611415 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.611559 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.611637 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.611789 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.611875 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.612024 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.612103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.612310 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.612398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.612544 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.612632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.612778 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.612855 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.613012 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.613088 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.613248 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.613333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.613482 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.613559 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.613728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.613806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.613963 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.614048 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.614202 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.614281 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.614440 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.614518 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.614675 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.614759 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.614911 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.615036 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.615146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.615233 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.615377 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.615466 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.615667 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.615746 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.615906 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.615989 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.616168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.616292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.616405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.616534 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.616663 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.616781 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.616895 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.617026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.617151 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.617270 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.617391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.617504 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.617618 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.617806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.617806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.618032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.618704 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.618836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.618962 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.619087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.619213 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.619335 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.619457 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.619572 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.619686 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.619801 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.619926 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.620042 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.620171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.620289 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.620404 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.620518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.620645 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.620761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.620761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.620976 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.621090 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.621210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.621335 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.621456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.621578 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.621693 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.621815 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.621932 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.622054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.622170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.622284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.622400 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.622513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.622633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.622757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.622872 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.622987 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.623109 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.623225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.623339 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.623462 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.623578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.623692 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.623811 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.623926 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.624040 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.624186 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.624305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.624421 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.624536 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.624649 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.624763 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.624888 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.625004 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.625118 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.625232 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.625367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.625484 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.625607 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.625724 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.625838 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.625953 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.626067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.626181 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.626303 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.626420 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.626542 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.626658 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.626772 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.626887 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.627009 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.external = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.627126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.627244 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.627365 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.627365 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.627581 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.627707 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.627834 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.627834 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.password = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.628049 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.628205 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] auth.token = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.628323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.628476 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.628603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.628730 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.628847 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] auth.external = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.628962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.629078 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.629198 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.629198 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.629424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.629542 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.629663 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.629779 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.629900 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] auth.password = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.630016 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.630142 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] auth.token = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.630258 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.630373 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.630487 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.630603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.630718 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.630842 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.630958 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.631080 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.631202 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.631318 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.631503 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.631628 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.631744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.631869 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.631986 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.632101 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] credential.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.632232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.632351 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.632467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.632581 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.632581 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.632796 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.632923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.633040 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.633155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.633269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.633385 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.633499 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.633622 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.633744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.633744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.633962 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.634077 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.634192 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.634315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.634432 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.634555 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.634672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.634787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.634902 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.635029 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.635147 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.635263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.635377 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.635493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.635608 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.635734 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.635851 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] federation.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.635967 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.636082 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.636215 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.636342 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.636467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.636593 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.636709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.636824 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.636939 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.637061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.637186 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.637308 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.637423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.637545 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.637661 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.637777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.637900 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.637900 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.638120 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.638235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.638350 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.638464 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.638587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.638704 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.638820 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.638934 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.639049 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.639165 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.639288 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.639405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.639521 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.639636 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.639751 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.639865 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.639991 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.640108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.640254 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.640370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.640485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.640600 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.640728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.640846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.640962 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.641076 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.641192 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.641315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.641432 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.641547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.641662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.641776 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.641891 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.642014 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.642131 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.642247 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.642362 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.642476 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.642591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.642714 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.642831 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.642947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.643062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.643176 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.643291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.643417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.643534 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.643650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.643765 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.643879 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.644001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.644140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.644260 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.644376 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.644491 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.644606 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.644720 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.644847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.644965 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.645080 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.645080 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.645295 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.645411 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.645534 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.645650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.645765 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.645891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.646008 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.646123 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.646246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.646362 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.646479 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.646594 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.646709 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.646823 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.646947 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.647064 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.647189 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.647312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.647434 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.647567 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.647680 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.647796 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.647913 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.648029 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.648161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.648279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.648407 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.648525 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.648641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.648756 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.648871 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.648986 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.649109 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.649226 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.649342 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.649465 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.649582 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.649696 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.649696 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.649922 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.650036 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.650152 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.650266 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.650381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.650503 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.650620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.650735 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.650856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.650972 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.651086 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.651208 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.651326 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.651441 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.651556 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.651670 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.651786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.651909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.652026 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.652194 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.652313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.652428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.652543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.652669 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.652789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.652904 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.653019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.653134 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.653249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.653372 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.653489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.653603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.653718 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.653880 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.654073 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.654192 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.654308 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.654423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.654538 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.654652 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.654775 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.654894 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.654994 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.655107 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.655223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.655338 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.655461 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.655578 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.655694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.655809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.655925 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.656040 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.656179 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.656298 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.656406 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.656504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.656625 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.656741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.656867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.656986 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.657101 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.657219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.657333 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.657448 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.657571 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.657688 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.657803 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.657918 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.658034 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.658149 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.658271 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.658388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.658503 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.658618 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.658732 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.658847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.658970 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.659087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.659203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.659318 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.659432 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.659546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] role.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.659669 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.659785 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] role.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.659900 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] resource.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.660014 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.660195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.660314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.660442 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.660560 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.660676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.660791 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.660906 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.661021 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.661146 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.661262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.661377 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.661491 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.661606 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.661721 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.661847 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.661964 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.662080 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.662195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.662311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] role.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.662426 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.662550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] role.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.662666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.662781 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.662896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.663011 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.663126 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.663251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.663368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.663483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.663598 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.663713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.663828 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.663952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.664069 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.664197 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.664315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.664430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.664557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.664676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.664791 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.665389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.665509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.665625 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.665749 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.665866 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.665982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.666103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.666220 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.666220 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.666454 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.666571 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.666687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.666802 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.666917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.667033 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.667160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.667278 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.667393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.667548 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.667548 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.667765 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.667888 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.668005 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.668005 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.668244 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.668360 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.668476 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.668603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.668721 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.668836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.668952 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.669067 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.669182 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.669305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.669423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.669539 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.669654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.669769 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.669884 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.670008 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.670126 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.670241 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.670362 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.670362 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.670580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.670704 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.670820 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.670820 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.671037 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.671137 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] token.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.671251 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.671624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.671726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.671790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.671850 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.671917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.671993 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.672074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.672211 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.672285 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.672356 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.connection = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.672441 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.672572 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.672677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.672808 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.672894 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.673047 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.673127 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.673291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.673370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.673527 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.673608 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.673765 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.673844 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.674000 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.674079 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.674237 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.674319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.674482 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.674561 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.674720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.674800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.674967 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.675049 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.675202 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.675369 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.connection = **** {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.675472 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.675557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.675670 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.675800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.675913 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.676046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.676176 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.676320 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.676401 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.676562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.676645 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.676773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87489) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 15:10:25.676853 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.677036 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.677279 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.677531 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.677774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.678025 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.678268 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.678523 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.678766 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.679018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.679256 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.679502 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.679745 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 15:10:25.679920 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87488) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 15:10:25.717135 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.717135 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.717820 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.718106 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.718344 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.718580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.727319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.729410 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.759700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.759864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.760500 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.760738 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.821238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.821705 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.880815 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.881048 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.881162 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.881276 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.948540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.948775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.948996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.949090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.949222 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.949313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.949443 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.949531 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.949660 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.949755 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.949903 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.950122 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.978284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.978427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.978526 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.978665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.978756 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.978892 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.978977 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.979116 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.979216 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.979335 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.979420 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.979545 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.979628 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.979759 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.990633 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:25.990847 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.007824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.008055 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.008202 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.008312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.008391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.008534 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.008620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.008784 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.008888 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.009000 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.009084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.009212 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87489) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.009296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.009425 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87488) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 15:10:26.027006 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.027161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 15:10:26.027248 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.027393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 15:10:26.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.027680 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 15:10:26.027836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.027920 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 15:10:26.027993 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.028199 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.028301 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.028458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.028555 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.028713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.028796 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.028972 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.038807 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.038915 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.039084 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.039169 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.039357 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.039458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.039641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.039728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.049345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.049737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.052389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.052673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.052841 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.052957 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.053120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058089 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058179 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058258 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058329 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058477 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058565 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058717 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058790 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058863 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.058946 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.059022 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.059095 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.059169 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.059243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.059243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.078390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.079964 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.080264 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.084304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.086064 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.090266 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.090358 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.090358 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.090358 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.091931 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.092241 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.092522 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.096482 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.096773 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.099505 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.099783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.101317 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.101317 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.101495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.101689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.102080 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.102392 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.103273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.103553 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.106085 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.106085 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.106085 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.106085 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.106085 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.106470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.106613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.107008 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.119627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.119910 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.123467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.123744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.123849 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.126932 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.127235 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.127771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.131190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.136221 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.136322 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.136322 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.136467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.138699 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.139006 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.139298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.139465 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.139586 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.139975 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.140297 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.142723 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.143027 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.143310 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.143592 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.143976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.144326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.156743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.157035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.157306 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.157572 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.160925 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.161212 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.161555 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.161904 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.164586 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.166479 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.166767 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.168830 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.169522 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.169811 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.170101 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.170387 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.170676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.170773 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.170953 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.174052 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.174333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.174610 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.174890 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.175167 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.182503 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.187794 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.187794 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.187794 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.187794 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.187794 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.187794 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.188158 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.188158 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.188158 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.188158 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.188158 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.188158 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.188716 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.200286 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.203294 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.204598 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.207383 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.207625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.209130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.210452 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.210738 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.211023 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.211733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.213761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.215265 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.215545 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.215824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.320608 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.322353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.325345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.325608 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.325899 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.326182 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.327318 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.328910 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.331793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.332078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.332390 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.332669 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.334205 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.334501 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.334788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.341353 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.341644 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.341990 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.342361 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87488) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.348150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87488) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.348891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87489) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 15:10:26.349211 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.349494 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.349781 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.350058 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.350340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.350617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.350897 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.351177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.351448 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.351718 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.351989 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.352284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.352575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87489) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 15:10:26.379319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5635dab779c0 pid: 87488 (default app) Jul 26 15:10:26.383050 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558daa7-fd2e-4ec6-ae01-da85ee12d51a None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:26.383345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558daa7-fd2e-4ec6-ae01-da85ee12d51a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:26.384166 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558daa7-fd2e-4ec6-ae01-da85ee12d51a None None] PATH_INFO: `/v3` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:26.386608 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5635dab779c0 pid: 87489 (default app) Jul 26 15:10:26.388386 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 1/1] 10.222.0.100 () {50 vars in 796 bytes} [Tue Jul 26 15:10:26 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:35.872707 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06c4d2-9e38-4c93-8e9e-1f44990fdd02 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:35.873330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06c4d2-9e38-4c93-8e9e-1f44990fdd02 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:35.873330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06c4d2-9e38-4c93-8e9e-1f44990fdd02 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:35.877480 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 1/2] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:35 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:10:35.883625 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:35.884094 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:35.884248 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:35.961172 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: INFO dbcounter [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] Registered counter for database keystone Jul 26 15:10:35.983541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG oslo_db.sqlalchemy.engines [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87488) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:10:35.989874 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writer thread running {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:10:36.168972 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG passlib.handlers.bcrypt [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87488) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 15:10:36.169306 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG passlib.handlers.bcrypt [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87488) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 15:10:36.223861 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:36.225529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:36.352587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 2/3] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:35 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 15:10:36.521724 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06c4d2-9e38-4c93-8e9e-1f44990fdd02 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:36.597368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: INFO dbcounter [None req-6e06c4d2-9e38-4c93-8e9e-1f44990fdd02 None None] Registered counter for database keystone Jul 26 15:10:36.617082 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG oslo_db.sqlalchemy.engines [None req-6e06c4d2-9e38-4c93-8e9e-1f44990fdd02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87489) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 15:10:36.623909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writer thread running {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 15:10:36.742383 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06c4d2-9e38-4c93-8e9e-1f44990fdd02 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:36.747168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892adcc-c16e-43a9-b16c-fbc803cf6712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:36.747800 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892adcc-c16e-43a9-b16c-fbc803cf6712 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:36.748086 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892adcc-c16e-43a9-b16c-fbc803cf6712 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:36.748394 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892adcc-c16e-43a9-b16c-fbc803cf6712 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:36.756749 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892adcc-c16e-43a9-b16c-fbc803cf6712 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:36.808434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e892adcc-c16e-43a9-b16c-fbc803cf6712 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 15:10:36.808771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892adcc-c16e-43a9-b16c-fbc803cf6712 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:36.818436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 2/4] 10.222.0.100 () {58 vars in 1329 bytes} [Tue Jul 26 15:10:36 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 15:10:36.825163 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:36.840665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec5f70-5c4c-40f7-8d2b-a314e8f9d441 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:36.845139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49051664-f89c-4e93-96f2-6fbde28307ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:36.846229 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051664-f89c-4e93-96f2-6fbde28307ec admin admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:36.846515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051664-f89c-4e93-96f2-6fbde28307ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:36.846783 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051664-f89c-4e93-96f2-6fbde28307ec admin admin] PATH_INFO: `/v3/projects/bca50b89fb044b68b53520d35aa1aa1b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:36.848359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49051664-f89c-4e93-96f2-6fbde28307ec admin admin] RBAC: Authorizing `identity:get_project(project_id=bca50b89fb044b68b53520d35aa1aa1b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:36.900618 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: WARNING keystone.common.rbac_enforcer.enforcer [None req-49051664-f89c-4e93-96f2-6fbde28307ec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 15:10:36.901232 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49051664-f89c-4e93-96f2-6fbde28307ec admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:36.916734 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 3/5] 10.222.0.100 () {56 vars in 1212 bytes} [Tue Jul 26 15:10:36 2022] GET /identity/v3/projects/bca50b89fb044b68b53520d35aa1aa1b => generated 345 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:39.113195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f2f9b-f451-4c64-b88f-73e77a31678e None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:39.113710 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f2f9b-f451-4c64-b88f-73e77a31678e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:39.113792 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f2f9b-f451-4c64-b88f-73e77a31678e None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:39.117945 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 3/6] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:39 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:39.123339 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775e95-dc26-42c5-b637-e7e4ad4d25de None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:39.123745 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775e95-dc26-42c5-b637-e7e4ad4d25de None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:39.123904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775e95-dc26-42c5-b637-e7e4ad4d25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:39.144069 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-08775e95-dc26-42c5-b637-e7e4ad4d25de None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:39.145651 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-08775e95-dc26-42c5-b637-e7e4ad4d25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:39.154219 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 4/7] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:39 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 15:10:39.177718 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f2f9b-f451-4c64-b88f-73e77a31678e None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:39.189824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f2f9b-f451-4c64-b88f-73e77a31678e None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:39.194108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a0bfd-b978-4d62-9b20-282bbcfd1d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:39.194707 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a0bfd-b978-4d62-9b20-282bbcfd1d86 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:39.194991 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a0bfd-b978-4d62-9b20-282bbcfd1d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:39.195268 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a0bfd-b978-4d62-9b20-282bbcfd1d86 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:39.202922 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a0bfd-b978-4d62-9b20-282bbcfd1d86 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:39.204761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a0bfd-b978-4d62-9b20-282bbcfd1d86 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:39.214042 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 4/8] 10.222.0.100 () {58 vars in 1329 bytes} [Tue Jul 26 15:10:39 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 15:10:39.219498 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08775e95-dc26-42c5-b637-e7e4ad4d25de None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:39.229496 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08775e95-dc26-42c5-b637-e7e4ad4d25de None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:39.233903 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02911968-d378-449e-a865-61ff28dbf5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:39.234532 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02911968-d378-449e-a865-61ff28dbf5fa admin admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:39.234833 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02911968-d378-449e-a865-61ff28dbf5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:39.235108 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02911968-d378-449e-a865-61ff28dbf5fa admin admin] PATH_INFO: `/v3/users/181490f42ff9443cbbe22f95fe330067` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:39.236486 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02911968-d378-449e-a865-61ff28dbf5fa admin admin] RBAC: Authorizing `identity:get_user(user_id=181490f42ff9443cbbe22f95fe330067)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:39.238332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02911968-d378-449e-a865-61ff28dbf5fa admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:39.239865 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 5/9] 10.222.0.100 () {56 vars in 1203 bytes} [Tue Jul 26 15:10:39 2022] GET /identity/v3/users/181490f42ff9443cbbe22f95fe330067 => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:10:41.517670 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595246fd-89f1-472b-a156-ed84401fdb0c None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:41.518151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595246fd-89f1-472b-a156-ed84401fdb0c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:41.518289 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595246fd-89f1-472b-a156-ed84401fdb0c None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:41.519555 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 5/10] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:41.525070 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4381b3-724c-4923-b05f-09ff58e81599 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:41.525509 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4381b3-724c-4923-b05f-09ff58e81599 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:41.525640 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4381b3-724c-4923-b05f-09ff58e81599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:41.545880 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-2c4381b3-724c-4923-b05f-09ff58e81599 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:41.547262 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-2c4381b3-724c-4923-b05f-09ff58e81599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:41.587641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3528-2578-4a00-b1d3-87b6c4614283 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:41.587936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3528-2578-4a00-b1d3-87b6c4614283 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:41.588247 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d3528-2578-4a00-b1d3-87b6c4614283 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:41.589577 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 6/11] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:10:41.595600 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927a9f-9486-442c-9139-7592bbca3b1d None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:41.595897 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927a9f-9486-442c-9139-7592bbca3b1d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:41.596222 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927a9f-9486-442c-9139-7592bbca3b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:41.642378 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 6/12] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:41.642685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG passlib.handlers.bcrypt [None req-1f927a9f-9486-442c-9139-7592bbca3b1d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87489) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 15:10:41.643047 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG passlib.handlers.bcrypt [None req-1f927a9f-9486-442c-9139-7592bbca3b1d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87489) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 15:10:41.667019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4381b3-724c-4923-b05f-09ff58e81599 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:41.689526 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-1f927a9f-9486-442c-9139-7592bbca3b1d None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:41.691171 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-1f927a9f-9486-442c-9139-7592bbca3b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:41.691420 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:41.771487 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4381b3-724c-4923-b05f-09ff58e81599 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:41.797306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 7/13] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:10:41.807242 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed55969-a64c-4aaa-b09e-f6b1413b33d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:41.807902 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed55969-a64c-4aaa-b09e-f6b1413b33d9 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:41.808218 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed55969-a64c-4aaa-b09e-f6b1413b33d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:41.808509 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed55969-a64c-4aaa-b09e-f6b1413b33d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:41.820425 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927a9f-9486-442c-9139-7592bbca3b1d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:41.820568 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed55969-a64c-4aaa-b09e-f6b1413b33d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-eed55969-a64c-4aaa-b09e-f6b1413b33d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:10:41.828867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:10:41.829908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:10:41.830682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 7/14] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:10:41.836500 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed55969-a64c-4aaa-b09e-f6b1413b33d9 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:41.920415 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:41.927197 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927a9f-9486-442c-9139-7592bbca3b1d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:41.929469 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:41.939729 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed55969-a64c-4aaa-b09e-f6b1413b33d9 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:41.965401 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125f270-cc52-4b71-bdef-3e6567117992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:41.966280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f270-cc52-4b71-bdef-3e6567117992 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:41.966568 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f270-cc52-4b71-bdef-3e6567117992 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:41.966847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125f270-cc52-4b71-bdef-3e6567117992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:41.980437 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310ff40-9f2b-4af8-97db-ed9513eb3ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:41.981061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ff40-9f2b-4af8-97db-ed9513eb3ba4 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:41.981344 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ff40-9f2b-4af8-97db-ed9513eb3ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:41.981621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ff40-9f2b-4af8-97db-ed9513eb3ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:41.982349 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310ff40-9f2b-4af8-97db-ed9513eb3ba4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:41.982655 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310ff40-9f2b-4af8-97db-ed9513eb3ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:41.984062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310ff40-9f2b-4af8-97db-ed9513eb3ba4 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:41.996608 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 8/15] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:10:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:10:42.013853 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310ff40-9f2b-4af8-97db-ed9513eb3ba4 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:42.036162 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125f270-cc52-4b71-bdef-3e6567117992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:42.037838 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125f270-cc52-4b71-bdef-3e6567117992 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:42.105696 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310ff40-9f2b-4af8-97db-ed9513eb3ba4 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:42.137245 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 8/16] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:10:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:42.140979 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdf07a-d93b-4586-a504-509bbd85719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:42.142056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdf07a-d93b-4586-a504-509bbd85719b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:42.142056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdf07a-d93b-4586-a504-509bbd85719b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:42.142257 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdf07a-d93b-4586-a504-509bbd85719b None admin] PATH_INFO: `/v3/users/181490f42ff9443cbbe22f95fe330067` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:42.142866 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125f270-cc52-4b71-bdef-3e6567117992 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:42.143415 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdf07a-d93b-4586-a504-509bbd85719b None admin] RBAC: Authorizing `identity:get_user(user_id=181490f42ff9443cbbe22f95fe330067)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:42.145069 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdf07a-d93b-4586-a504-509bbd85719b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:42.145576 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:42.146663 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 9/17] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:10:42 2022] GET /identity/v3/users/181490f42ff9443cbbe22f95fe330067 => generated 248 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:10:42.152554 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdf07a-d93b-4586-a504-509bbd85719b None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:42.167113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:42.238033 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125f270-cc52-4b71-bdef-3e6567117992 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:42.250741 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdf07a-d93b-4586-a504-509bbd85719b None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:42.272647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ddf89-a2a0-4bf2-8029-32ff04f5743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:42.273574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ddf89-a2a0-4bf2-8029-32ff04f5743e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:42.273856 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ddf89-a2a0-4bf2-8029-32ff04f5743e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:42.274126 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ddf89-a2a0-4bf2-8029-32ff04f5743e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:42.284146 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b719c-f4fd-44be-8007-5e6302a2b4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:42.284797 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b719c-f4fd-44be-8007-5e6302a2b4ca None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:42.285084 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b719c-f4fd-44be-8007-5e6302a2b4ca None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:42.285362 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b719c-f4fd-44be-8007-5e6302a2b4ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:42.286587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b719c-f4fd-44be-8007-5e6302a2b4ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:42.288010 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b719c-f4fd-44be-8007-5e6302a2b4ca None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:42.290195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 10/18] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:10:42 2022] GET /identity/v3/domains/default => generated 200 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:10:42.295454 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ddf89-a2a0-4bf2-8029-32ff04f5743e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:42.296325 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b719c-f4fd-44be-8007-5e6302a2b4ca None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:42.296980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ddf89-a2a0-4bf2-8029-32ff04f5743e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-697ddf89-a2a0-4bf2-8029-32ff04f5743e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:10:42.315282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:10:42.316314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:10:42.317367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:10:42.317367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:10:42.317367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:10:42.317367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:10:42.317367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 9/19] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:10:42.323213 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ddf89-a2a0-4bf2-8029-32ff04f5743e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:42.378933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:42.380825 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:42.399993 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b719c-f4fd-44be-8007-5e6302a2b4ca None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:42.421658 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ddf89-a2a0-4bf2-8029-32ff04f5743e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:42.434217 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b02ff-1298-447a-9f49-2ef719198ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:42.434834 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b02ff-1298-447a-9f49-2ef719198ba6 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:42.435120 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b02ff-1298-447a-9f49-2ef719198ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:42.435395 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b02ff-1298-447a-9f49-2ef719198ba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:42.436215 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b02ff-1298-447a-9f49-2ef719198ba6 None admin] RBAC: Adding query filter params (role.id=6d23401ca57e47398bf036ea320a7617, scope.domain.id=default, user.id=181490f42ff9443cbbe22f95fe330067) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:42.436527 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b02ff-1298-447a-9f49-2ef719198ba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:42.437990 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b02ff-1298-447a-9f49-2ef719198ba6 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:42.444601 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 11/20] 10.222.0.100 () {56 vars in 1327 bytes} [Tue Jul 26 15:10:42 2022] GET /identity/v3/role_assignments?user.id=181490f42ff9443cbbe22f95fe330067&scope.domain.id=default&role.id=6d23401ca57e47398bf036ea320a7617 => generated 234 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:10:42.459961 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bdbca-9a49-43e4-94d7-f31b7feb5ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:42.461187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bdbca-9a49-43e4-94d7-f31b7feb5ae2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:42.461477 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bdbca-9a49-43e4-94d7-f31b7feb5ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:42.461756 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bdbca-9a49-43e4-94d7-f31b7feb5ae2 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:42.462488 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bdbca-9a49-43e4-94d7-f31b7feb5ae2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:42.462797 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bdbca-9a49-43e4-94d7-f31b7feb5ae2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:42.464281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bdbca-9a49-43e4-94d7-f31b7feb5ae2 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:42.484910 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 10/21] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:10:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:10:45.023709 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb82e5-2996-4eff-bfcd-5c0f9937b836 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.024793 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb82e5-2996-4eff-bfcd-5c0f9937b836 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.024793 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb82e5-2996-4eff-bfcd-5c0f9937b836 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.025651 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 12/22] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:45.047875 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce4d5d-c09a-439d-86bc-aaa8eaa1b44b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.048427 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce4d5d-c09a-439d-86bc-aaa8eaa1b44b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.048855 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce4d5d-c09a-439d-86bc-aaa8eaa1b44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.073267 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-2bce4d5d-c09a-439d-86bc-aaa8eaa1b44b None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:45.074476 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-2bce4d5d-c09a-439d-86bc-aaa8eaa1b44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:45.145713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84127899-e71f-40a7-9e76-51e826f0a76f None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.145713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84127899-e71f-40a7-9e76-51e826f0a76f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.145713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84127899-e71f-40a7-9e76-51e826f0a76f None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.145713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 13/23] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:45.154763 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634063b-00c6-4192-a183-7969bbe3b032 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.155050 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634063b-00c6-4192-a183-7969bbe3b032 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.155328 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634063b-00c6-4192-a183-7969bbe3b032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.184256 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 11/24] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:45.189504 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-9634063b-00c6-4192-a183-7969bbe3b032 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:45.190811 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-9634063b-00c6-4192-a183-7969bbe3b032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:45.216036 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce4d5d-c09a-439d-86bc-aaa8eaa1b44b None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:45.304755 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 14/25] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:10:45.326167 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:45.357719 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634063b-00c6-4192-a183-7969bbe3b032 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:45.429595 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce4d5d-c09a-439d-86bc-aaa8eaa1b44b None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:45.482004 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:45.524170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634063b-00c6-4192-a183-7969bbe3b032 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:45.527676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0060e01-ba0b-4688-810d-83c55628422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:45.528363 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060e01-ba0b-4688-810d-83c55628422e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.528642 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060e01-ba0b-4688-810d-83c55628422e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.528914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060e01-ba0b-4688-810d-83c55628422e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.551535 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0060e01-ba0b-4688-810d-83c55628422e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-d0060e01-ba0b-4688-810d-83c55628422e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:10:45.559518 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:10:45.560455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:10:45.561340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:10:45.568078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 12/26] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:10:45.569597 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d385-994e-49be-b1df-bba40a579fb2 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.570441 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d385-994e-49be-b1df-bba40a579fb2 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.570718 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8d385-994e-49be-b1df-bba40a579fb2 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.578383 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 13/27] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:45 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:45.580802 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d385-994e-49be-b1df-bba40a579fb2 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:45.591139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd530f-8eaf-4f5e-acec-241167b5dddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:45.591835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd530f-8eaf-4f5e-acec-241167b5dddf None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.592133 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd530f-8eaf-4f5e-acec-241167b5dddf None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.592418 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd530f-8eaf-4f5e-acec-241167b5dddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.604663 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd530f-8eaf-4f5e-acec-241167b5dddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:45.606710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd530f-8eaf-4f5e-acec-241167b5dddf None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-1ebd530f-8eaf-4f5e-acec-241167b5dddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:10:45.626907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:10:45.627968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:10:45.628905 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:10:45.628905 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:10:45.628905 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:10:45.628905 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:10:45.633452 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 15/28] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:10:45.639512 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745fb2b-f058-49b7-822e-ce5b9504c674 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.639512 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745fb2b-f058-49b7-822e-ce5b9504c674 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.639512 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745fb2b-f058-49b7-822e-ce5b9504c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.676793 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-6745fb2b-f058-49b7-822e-ce5b9504c674 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:45.678012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-6745fb2b-f058-49b7-822e-ce5b9504c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:45.772139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8d385-994e-49be-b1df-bba40a579fb2 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:45.789256 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:45.806096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 16/29] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:45.806970 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745fb2b-f058-49b7-822e-ce5b9504c674 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:45.852426 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b128b55-5f76-444d-8eee-7511cff64064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:45.852975 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128b55-5f76-444d-8eee-7511cff64064 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:45.853255 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128b55-5f76-444d-8eee-7511cff64064 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:45.853526 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128b55-5f76-444d-8eee-7511cff64064 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:45.854246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b128b55-5f76-444d-8eee-7511cff64064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:45.857523 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b128b55-5f76-444d-8eee-7511cff64064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:45.858934 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b128b55-5f76-444d-8eee-7511cff64064 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:45.891309 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 14/30] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:10:45 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:45.892337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b128b55-5f76-444d-8eee-7511cff64064 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:45.923211 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:45.976602 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745fb2b-f058-49b7-822e-ce5b9504c674 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.014816 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b128b55-5f76-444d-8eee-7511cff64064 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.016491 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d9c25-1b33-4b24-9184-62c71d81765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.017122 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d9c25-1b33-4b24-9184-62c71d81765f None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.017407 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d9c25-1b33-4b24-9184-62c71d81765f None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.017689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d9c25-1b33-4b24-9184-62c71d81765f None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.018453 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d9c25-1b33-4b24-9184-62c71d81765f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:46.018765 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d9c25-1b33-4b24-9184-62c71d81765f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.020190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d9c25-1b33-4b24-9184-62c71d81765f None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.038043 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 17/31] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:10:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:46.039417 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d9c25-1b33-4b24-9184-62c71d81765f None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.051444 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2e664-502c-411b-9176-35d368c79537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.052141 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2e664-502c-411b-9176-35d368c79537 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.052430 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2e664-502c-411b-9176-35d368c79537 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.052706 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2e664-502c-411b-9176-35d368c79537 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.053420 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2e664-502c-411b-9176-35d368c79537 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.055335 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2e664-502c-411b-9176-35d368c79537 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.148607 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d9c25-1b33-4b24-9184-62c71d81765f None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.165932 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:46.185712 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e4e1-8275-4795-af47-45de6216749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.186423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e4e1-8275-4795-af47-45de6216749b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.186758 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e4e1-8275-4795-af47-45de6216749b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.187044 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e4e1-8275-4795-af47-45de6216749b None admin] PATH_INFO: `/v3/users/181490f42ff9443cbbe22f95fe330067` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.188390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77e4e1-8275-4795-af47-45de6216749b None admin] RBAC: Authorizing `identity:get_user(user_id=181490f42ff9443cbbe22f95fe330067)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.189921 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77e4e1-8275-4795-af47-45de6216749b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.191635 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 18/32] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:10:46 2022] GET /identity/v3/users/181490f42ff9443cbbe22f95fe330067 => generated 248 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:46.192799 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e292e-1443-4552-9b79-eb434cb20968 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.193090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e292e-1443-4552-9b79-eb434cb20968 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.193371 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e292e-1443-4552-9b79-eb434cb20968 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.194725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 19/33] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:46.195430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e292e-1443-4552-9b79-eb434cb20968 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.313272 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e292e-1443-4552-9b79-eb434cb20968 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.314281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 15/34] 10.222.0.100 () {60 vars in 1136 bytes} [Tue Jul 26 15:10:45 2022] POST /identity/v3/roles => generated 220 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:46.315467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2e664-502c-411b-9176-35d368c79537 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.359472 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:46.359983 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792955-f269-4074-a376-37347c8b6c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.360651 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792955-f269-4074-a376-37347c8b6c51 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.361198 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792955-f269-4074-a376-37347c8b6c51 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.361198 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed792955-f269-4074-a376-37347c8b6c51 None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.361891 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed792955-f269-4074-a376-37347c8b6c51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.363413 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed792955-f269-4074-a376-37347c8b6c51 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.449005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2e664-502c-411b-9176-35d368c79537 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.493761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d56064-c778-4014-be29-f9e14daf4f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.494449 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d56064-c778-4014-be29-f9e14daf4f2f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.494751 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d56064-c778-4014-be29-f9e14daf4f2f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.495012 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d56064-c778-4014-be29-f9e14daf4f2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.496701 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d56064-c778-4014-be29-f9e14daf4f2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.498351 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d56064-c778-4014-be29-f9e14daf4f2f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.500107 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 16/35] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:10:46 2022] GET /identity/v3/domains/default => generated 200 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:46.501418 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682ce57-2e66-4a81-bb90-392f45424ad4 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.501706 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682ce57-2e66-4a81-bb90-392f45424ad4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.501989 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682ce57-2e66-4a81-bb90-392f45424ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.523670 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-2682ce57-2e66-4a81-bb90-392f45424ad4 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:46.524952 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-2682ce57-2e66-4a81-bb90-392f45424ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:46.611195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 17/36] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:46.612032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682ce57-2e66-4a81-bb90-392f45424ad4 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.652511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:46.664268 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 20/37] 10.222.0.100 () {60 vars in 1146 bytes} [Tue Jul 26 15:10:46 2022] POST /identity/v3/projects => generated 302 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:46.725433 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792955-f269-4074-a376-37347c8b6c51 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:46.763355 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682ce57-2e66-4a81-bb90-392f45424ad4 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.814993 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:46.851631 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5e03-c531-4cc2-904c-9a2809aaaf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.852361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5e03-c531-4cc2-904c-9a2809aaaf43 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.852643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5e03-c531-4cc2-904c-9a2809aaaf43 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.852932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5e03-c531-4cc2-904c-9a2809aaaf43 None admin] PATH_INFO: `/v3/domains/default/users/181490f42ff9443cbbe22f95fe330067/roles/6d23401ca57e47398bf036ea320a7617` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.856255 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea5e03-c531-4cc2-904c-9a2809aaaf43 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=181490f42ff9443cbbe22f95fe330067, role_id=6d23401ca57e47398bf036ea320a7617)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.857779 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea5e03-c531-4cc2-904c-9a2809aaaf43 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:46.922989 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed792955-f269-4074-a376-37347c8b6c51 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:46.961798 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e5aa7-a1bf-4745-8472-b42211c55797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:46.964937 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e5aa7-a1bf-4745-8472-b42211c55797 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:46.964937 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e5aa7-a1bf-4745-8472-b42211c55797 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:46.964937 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e5aa7-a1bf-4745-8472-b42211c55797 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:46.964937 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e5aa7-a1bf-4745-8472-b42211c55797 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:46.965374 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e5aa7-a1bf-4745-8472-b42211c55797 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.015580 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 18/38] 10.222.0.100 () {58 vars in 1366 bytes} [Tue Jul 26 15:10:46 2022] PUT /identity/v3/domains/default/users/181490f42ff9443cbbe22f95fe330067/roles/6d23401ca57e47398bf036ea320a7617 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:10:47.016605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10d13-138d-41a1-810c-c309f58421e3 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.024225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10d13-138d-41a1-810c-c309f58421e3 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.024225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10d13-138d-41a1-810c-c309f58421e3 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.024225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 19/39] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:47.024225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec36d8-4489-4995-bb9c-d46ba96e4648 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.024225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec36d8-4489-4995-bb9c-d46ba96e4648 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.024225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec36d8-4489-4995-bb9c-d46ba96e4648 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.024225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 20/40] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:47 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:47.025642 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c023c-8304-4f06-aa9d-537992854e55 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.026027 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c023c-8304-4f06-aa9d-537992854e55 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.026308 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c023c-8304-4f06-aa9d-537992854e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.047572 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-eb9c023c-8304-4f06-aa9d-537992854e55 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:47.049106 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-eb9c023c-8304-4f06-aa9d-537992854e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:47.122434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 21/41] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:10:47.124530 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97891aae-6bb3-4b01-9bff-d857b7b8bc9c None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.124973 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97891aae-6bb3-4b01-9bff-d857b7b8bc9c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.125401 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97891aae-6bb3-4b01-9bff-d857b7b8bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.141790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 21/42] 10.222.0.100 () {60 vars in 1136 bytes} [Tue Jul 26 15:10:46 2022] POST /identity/v3/roles => generated 226 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:47.157132 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e5aa7-a1bf-4745-8472-b42211c55797 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:47.164027 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-97891aae-6bb3-4b01-9bff-d857b7b8bc9c None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:47.165505 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-97891aae-6bb3-4b01-9bff-d857b7b8bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:47.186055 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:47.282426 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 22/43] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:47.304707 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:47.307174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97891aae-6bb3-4b01-9bff-d857b7b8bc9c None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:47.312776 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e5aa7-a1bf-4745-8472-b42211c55797 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:47.360317 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437f0ea-66b4-4eee-b87d-feff8d420f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:47.361158 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f0ea-66b4-4eee-b87d-feff8d420f9f None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.361517 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f0ea-66b4-4eee-b87d-feff8d420f9f None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.361802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f0ea-66b4-4eee-b87d-feff8d420f9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.363158 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437f0ea-66b4-4eee-b87d-feff8d420f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:47.364663 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437f0ea-66b4-4eee-b87d-feff8d420f9f None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.366911 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 22/44] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:10:47 2022] GET /identity/v3/domains/default => generated 200 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:47.372960 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437f0ea-66b4-4eee-b87d-feff8d420f9f None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:47.441161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97891aae-6bb3-4b01-9bff-d857b7b8bc9c None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:47.482628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e0eee-67fa-4078-8d42-98baa6c03340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:47.483393 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e0eee-67fa-4078-8d42-98baa6c03340 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.483705 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e0eee-67fa-4078-8d42-98baa6c03340 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.484050 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e0eee-67fa-4078-8d42-98baa6c03340 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.484874 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e0eee-67fa-4078-8d42-98baa6c03340 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:47.486347 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e0eee-67fa-4078-8d42-98baa6c03340 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.497527 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437f0ea-66b4-4eee-b87d-feff8d420f9f None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:47.533410 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb1607-977f-4d95-9f51-0385e261ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:47.533969 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb1607-977f-4d95-9f51-0385e261ed9e None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:47.534325 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb1607-977f-4d95-9f51-0385e261ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:47.534540 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb1607-977f-4d95-9f51-0385e261ed9e None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:47.535230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb1607-977f-4d95-9f51-0385e261ed9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:47.536781 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb1607-977f-4d95-9f51-0385e261ed9e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:47.598630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 23/45] 10.222.0.100 () {60 vars in 1136 bytes} [Tue Jul 26 15:10:47 2022] POST /identity/v3/roles => generated 224 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:47.674959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 23/46] 10.222.0.100 () {60 vars in 1146 bytes} [Tue Jul 26 15:10:47 2022] POST /identity/v3/projects => generated 313 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:49.347746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45fa3c-374c-448c-96aa-66a057f2f3db None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:49.348322 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45fa3c-374c-448c-96aa-66a057f2f3db None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:49.348322 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45fa3c-374c-448c-96aa-66a057f2f3db None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:49.349662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 24/47] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:49.354971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aacd2-7942-4b83-9fef-bafcded5cbe8 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:49.355344 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aacd2-7942-4b83-9fef-bafcded5cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:49.355539 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aacd2-7942-4b83-9fef-bafcded5cbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:49.374148 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-b11aacd2-7942-4b83-9fef-bafcded5cbe8 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:49.375662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-b11aacd2-7942-4b83-9fef-bafcded5cbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:49.387055 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:49.443282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 24/48] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:49.467708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45fa3c-374c-448c-96aa-66a057f2f3db None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:49.477125 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:49.574573 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45fa3c-374c-448c-96aa-66a057f2f3db None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:49.607235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331173b5-6184-4d65-a8f5-1b766822dfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:49.607804 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331173b5-6184-4d65-a8f5-1b766822dfbd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:49.608087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331173b5-6184-4d65-a8f5-1b766822dfbd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:49.608405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331173b5-6184-4d65-a8f5-1b766822dfbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:49.619974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331173b5-6184-4d65-a8f5-1b766822dfbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-331173b5-6184-4d65-a8f5-1b766822dfbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:10:49.625312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:10:49.626140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:10:49.626965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 25/49] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:10:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:10:49.632381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aacd2-7942-4b83-9fef-bafcded5cbe8 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:49.732823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aacd2-7942-4b83-9fef-bafcded5cbe8 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:49.767992 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438d13-a08f-412e-8e34-9fd52a95fa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:49.768688 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438d13-a08f-412e-8e34-9fd52a95fa15 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:49.768979 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438d13-a08f-412e-8e34-9fd52a95fa15 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:49.769259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438d13-a08f-412e-8e34-9fd52a95fa15 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:49.769982 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03438d13-a08f-412e-8e34-9fd52a95fa15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:49.770313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03438d13-a08f-412e-8e34-9fd52a95fa15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:49.771752 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03438d13-a08f-412e-8e34-9fd52a95fa15 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:49.780349 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 25/50] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:10:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:10:49.786037 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331173b5-6184-4d65-a8f5-1b766822dfbd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:49.857418 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:49.890565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331173b5-6184-4d65-a8f5-1b766822dfbd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:49.924060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71510e-4290-4a98-aaa1-79ab843f70ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:49.924730 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71510e-4290-4a98-aaa1-79ab843f70ef None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:49.925015 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71510e-4290-4a98-aaa1-79ab843f70ef None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:49.925432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71510e-4290-4a98-aaa1-79ab843f70ef None admin] PATH_INFO: `/v3/users/181490f42ff9443cbbe22f95fe330067` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:49.926477 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71510e-4290-4a98-aaa1-79ab843f70ef None admin] RBAC: Authorizing `identity:get_user(user_id=181490f42ff9443cbbe22f95fe330067)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:49.927938 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71510e-4290-4a98-aaa1-79ab843f70ef None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:49.929609 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 26/51] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:10:49 2022] GET /identity/v3/users/181490f42ff9443cbbe22f95fe330067 => generated 248 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:49.934968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438d13-a08f-412e-8e34-9fd52a95fa15 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:49.946364 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:49.976200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788f5f8-2696-4826-b035-a761c578d884 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:49.976489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788f5f8-2696-4826-b035-a761c578d884 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:49.976771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788f5f8-2696-4826-b035-a761c578d884 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:49.978101 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 27/52] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:10:49.983363 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8ab98-67d0-45b1-a36f-fa07ed2fc2de None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:49.983650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8ab98-67d0-45b1-a36f-fa07ed2fc2de None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:49.983930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8ab98-67d0-45b1-a36f-fa07ed2fc2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:50.005642 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-6da8ab98-67d0-45b1-a36f-fa07ed2fc2de None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:50.006883 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-6da8ab98-67d0-45b1-a36f-fa07ed2fc2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:50.050419 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438d13-a08f-412e-8e34-9fd52a95fa15 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:50.074069 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 28/53] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:10:50.085978 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a95c4-0b2a-479f-8517-f235c4482234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:50.086623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a95c4-0b2a-479f-8517-f235c4482234 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:50.086909 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a95c4-0b2a-479f-8517-f235c4482234 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:50.087190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a95c4-0b2a-479f-8517-f235c4482234 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:50.088423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a95c4-0b2a-479f-8517-f235c4482234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:50.090000 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a95c4-0b2a-479f-8517-f235c4482234 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:50.091569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 26/54] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:10:49 2022] GET /identity/v3/domains/default => generated 200 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:50.097313 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8ab98-67d0-45b1-a36f-fa07ed2fc2de None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:50.098266 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a95c4-0b2a-479f-8517-f235c4482234 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:50.165190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:50.178497 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:50.202311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a95c4-0b2a-479f-8517-f235c4482234 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:50.202884 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8ab98-67d0-45b1-a36f-fa07ed2fc2de None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:50.236148 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8583a-dc27-479f-9912-e423f338ffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:50.236756 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8583a-dc27-479f-9912-e423f338ffeb None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:50.237041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8583a-dc27-479f-9912-e423f338ffeb None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:50.237183 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeccff5-a652-471e-88ae-0f6e7424205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:50.237320 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8583a-dc27-479f-9912-e423f338ffeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:50.237831 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeccff5-a652-471e-88ae-0f6e7424205c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:50.238106 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8583a-dc27-479f-9912-e423f338ffeb None admin] RBAC: Adding query filter params (role.id=6d23401ca57e47398bf036ea320a7617, scope.domain.id=default, user.id=181490f42ff9443cbbe22f95fe330067) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:50.238201 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeccff5-a652-471e-88ae-0f6e7424205c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:50.238390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeccff5-a652-471e-88ae-0f6e7424205c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:50.238473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8583a-dc27-479f-9912-e423f338ffeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:50.239564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeccff5-a652-471e-88ae-0f6e7424205c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:50.239852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8583a-dc27-479f-9912-e423f338ffeb None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:50.241142 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeccff5-a652-471e-88ae-0f6e7424205c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:50.243420 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 27/55] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:10:50 2022] GET /identity/v3/domains/default => generated 200 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:10:50.258860 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 29/56] 10.222.0.100 () {56 vars in 1327 bytes} [Tue Jul 26 15:10:50 2022] GET /identity/v3/role_assignments?user.id=181490f42ff9443cbbe22f95fe330067&scope.domain.id=default&role.id=6d23401ca57e47398bf036ea320a7617 => generated 532 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:10:50.259075 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeccff5-a652-471e-88ae-0f6e7424205c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:50.356056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeccff5-a652-471e-88ae-0f6e7424205c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:50.391729 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771804c-6fdf-4616-bf52-2901437fb6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:50.392393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771804c-6fdf-4616-bf52-2901437fb6e3 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:50.392683 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771804c-6fdf-4616-bf52-2901437fb6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:50.392965 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771804c-6fdf-4616-bf52-2901437fb6e3 None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:50.393685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771804c-6fdf-4616-bf52-2901437fb6e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:50.395171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771804c-6fdf-4616-bf52-2901437fb6e3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:50.412251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:50.489922 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 28/57] 10.222.0.100 () {60 vars in 1145 bytes} [Tue Jul 26 15:10:50 2022] POST /identity/v3/projects => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:10:52.735254 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d633c-a0ab-48d9-86ad-94f9688135d5 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:52.735795 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d633c-a0ab-48d9-86ad-94f9688135d5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:52.735795 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d633c-a0ab-48d9-86ad-94f9688135d5 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:52.737179 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 30/58] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:52.742983 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696481-0f0e-4a54-bb1b-b4997ae4a8aa None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:52.743397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696481-0f0e-4a54-bb1b-b4997ae4a8aa None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:52.743496 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86696481-0f0e-4a54-bb1b-b4997ae4a8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:52.761561 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-86696481-0f0e-4a54-bb1b-b4997ae4a8aa None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:52.762748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-86696481-0f0e-4a54-bb1b-b4997ae4a8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:52.828056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 29/59] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:10:52.853569 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d633c-a0ab-48d9-86ad-94f9688135d5 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:52.955857 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d633c-a0ab-48d9-86ad-94f9688135d5 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:52.980749 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:52.988085 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03585ed-6073-437f-8c6a-0cbc31498f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:52.988746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03585ed-6073-437f-8c6a-0cbc31498f0a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:52.993860 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03585ed-6073-437f-8c6a-0cbc31498f0a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:52.993860 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03585ed-6073-437f-8c6a-0cbc31498f0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:52.993860 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03585ed-6073-437f-8c6a-0cbc31498f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:52.993860 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03585ed-6073-437f-8c6a-0cbc31498f0a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:52.994408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 31/60] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:10:52 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:52.999682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86696481-0f0e-4a54-bb1b-b4997ae4a8aa None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:53.097682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86696481-0f0e-4a54-bb1b-b4997ae4a8aa None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:53.124615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:53.133800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62aaa2-38e2-4723-8725-b786ef148f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:53.134424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62aaa2-38e2-4723-8725-b786ef148f51 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:53.134711 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62aaa2-38e2-4723-8725-b786ef148f51 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:53.134997 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62aaa2-38e2-4723-8725-b786ef148f51 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:53.135678 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62aaa2-38e2-4723-8725-b786ef148f51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:53.137176 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62aaa2-38e2-4723-8725-b786ef148f51 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:53.273119 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 30/61] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:10:52 2022] POST /identity/v3/users => generated 276 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:56.708006 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9d959-a502-45ae-812d-f7be2da83565 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:56.708539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9d959-a502-45ae-812d-f7be2da83565 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:56.708610 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9d959-a502-45ae-812d-f7be2da83565 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:56.709984 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 32/62] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:56.729555 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f532d1-d10f-49c5-adbd-f1485892f341 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:56.730021 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f532d1-d10f-49c5-adbd-f1485892f341 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:56.730113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f532d1-d10f-49c5-adbd-f1485892f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:56.758983 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb354b-9db7-45d9-82b1-6b2a64fb0341 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:56.759292 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb354b-9db7-45d9-82b1-6b2a64fb0341 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:56.759462 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb354b-9db7-45d9-82b1-6b2a64fb0341 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:56.760828 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 33/63] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:10:56.761171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-81f532d1-d10f-49c5-adbd-f1485892f341 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:56.762480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-81f532d1-d10f-49c5-adbd-f1485892f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:56.767662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366991a-d3ca-40ba-81cf-28917afad773 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:56.767945 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366991a-d3ca-40ba-81cf-28917afad773 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:56.768255 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366991a-d3ca-40ba-81cf-28917afad773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:56.793601 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-1366991a-d3ca-40ba-81cf-28917afad773 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:56.794821 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-1366991a-d3ca-40ba-81cf-28917afad773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:56.908871 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 31/64] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:56.922051 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 34/65] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:10:56.948680 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f532d1-d10f-49c5-adbd-f1485892f341 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:56.957497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366991a-d3ca-40ba-81cf-28917afad773 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:57.086155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f532d1-d10f-49c5-adbd-f1485892f341 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:57.103549 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:57.133958 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366991a-d3ca-40ba-81cf-28917afad773 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:57.135533 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e93d-f14f-4334-be40-c554300b059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:57.137330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e93d-f14f-4334-be40-c554300b059f None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.137859 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e93d-f14f-4334-be40-c554300b059f None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.138338 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e93d-f14f-4334-be40-c554300b059f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.154277 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5e93d-f14f-4334-be40-c554300b059f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:10:57.162017 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-81c5e93d-f14f-4334-be40-c554300b059f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:10:57.165052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:10:57.165890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:10:57.166667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:10:57.169379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 32/66] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:10:57.171589 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b8d8b-adf0-49a4-b429-7ead1b3e9dbf None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.172025 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b8d8b-adf0-49a4-b429-7ead1b3e9dbf None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.172458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b8d8b-adf0-49a4-b429-7ead1b3e9dbf None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.174138 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da428120-67e1-4170-85e9-887b2c4943f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:57.179833 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428120-67e1-4170-85e9-887b2c4943f5 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.179833 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428120-67e1-4170-85e9-887b2c4943f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.179833 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428120-67e1-4170-85e9-887b2c4943f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.182056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 33/67] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:57 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:57.183146 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b8d8b-adf0-49a4-b429-7ead1b3e9dbf None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:57.190082 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da428120-67e1-4170-85e9-887b2c4943f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-da428120-67e1-4170-85e9-887b2c4943f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:10:57.195337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:10:57.196403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:10:57.197346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:10:57.199083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 35/68] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:10:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:10:57.205907 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450474ad-6e70-4b30-8308-1cafd976fd8b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.206319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450474ad-6e70-4b30-8308-1cafd976fd8b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.206707 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450474ad-6e70-4b30-8308-1cafd976fd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.226237 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-450474ad-6e70-4b30-8308-1cafd976fd8b None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:57.227706 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-450474ad-6e70-4b30-8308-1cafd976fd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:57.302511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 36/69] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:57.317302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450474ad-6e70-4b30-8308-1cafd976fd8b None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:57.322072 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b8d8b-adf0-49a4-b429-7ead1b3e9dbf None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:57.366309 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73f6e0-c172-4ae8-a4f3-2fffeb157d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:57.366881 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f6e0-c172-4ae8-a4f3-2fffeb157d30 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.367170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f6e0-c172-4ae8-a4f3-2fffeb157d30 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.367458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f6e0-c172-4ae8-a4f3-2fffeb157d30 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.368237 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73f6e0-c172-4ae8-a4f3-2fffeb157d30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:57.368555 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73f6e0-c172-4ae8-a4f3-2fffeb157d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:57.370039 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73f6e0-c172-4ae8-a4f3-2fffeb157d30 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:57.379580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 34/70] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:10:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:57.380970 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9f7d9-92c7-4b29-8877-e7c20d937091 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.381301 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9f7d9-92c7-4b29-8877-e7c20d937091 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.381554 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9f7d9-92c7-4b29-8877-e7c20d937091 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.383094 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 35/71] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:57.383708 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9f7d9-92c7-4b29-8877-e7c20d937091 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:57.426876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:57.442753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450474ad-6e70-4b30-8308-1cafd976fd8b None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:57.461871 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:57.483376 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5a7e4-bb03-4c0a-81d0-f442c3e0ee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:57.484008 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5a7e4-bb03-4c0a-81d0-f442c3e0ee2f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.484371 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5a7e4-bb03-4c0a-81d0-f442c3e0ee2f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.484754 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5a7e4-bb03-4c0a-81d0-f442c3e0ee2f None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.485392 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5a7e4-bb03-4c0a-81d0-f442c3e0ee2f None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:57.485700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5a7e4-bb03-4c0a-81d0-f442c3e0ee2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:57.487106 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5a7e4-bb03-4c0a-81d0-f442c3e0ee2f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:57.496088 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 37/72] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:10:57 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:57.496928 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5a7e4-bb03-4c0a-81d0-f442c3e0ee2f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:57.508998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9f7d9-92c7-4b29-8877-e7c20d937091 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:57.547843 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cca05-b231-4ad9-895e-8b1b2e54cd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:57.548535 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cca05-b231-4ad9-895e-8b1b2e54cd88 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.548828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cca05-b231-4ad9-895e-8b1b2e54cd88 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.549112 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cca05-b231-4ad9-895e-8b1b2e54cd88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.559528 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cca05-b231-4ad9-895e-8b1b2e54cd88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-735cca05-b231-4ad9-895e-8b1b2e54cd88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:10:57.564458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:10:57.565845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:10:57.566684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 36/73] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:10:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:10:57.567303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155386f0-d0dd-4b5c-8a43-13a18915cc87 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.567303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155386f0-d0dd-4b5c-8a43-13a18915cc87 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.567701 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155386f0-d0dd-4b5c-8a43-13a18915cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.586605 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-155386f0-d0dd-4b5c-8a43-13a18915cc87 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:57.587824 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-155386f0-d0dd-4b5c-8a43-13a18915cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:57.606701 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5a7e4-bb03-4c0a-81d0-f442c3e0ee2f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:57.640064 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb2897-92ff-41b0-9bb1-6db74c28c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:57.640662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb2897-92ff-41b0-9bb1-6db74c28c808 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.640949 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb2897-92ff-41b0-9bb1-6db74c28c808 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.641228 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb2897-92ff-41b0-9bb1-6db74c28c808 None admin] PATH_INFO: `/v3/users/181490f42ff9443cbbe22f95fe330067` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.642452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb2897-92ff-41b0-9bb1-6db74c28c808 None admin] RBAC: Authorizing `identity:get_user(user_id=181490f42ff9443cbbe22f95fe330067)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:57.643941 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb2897-92ff-41b0-9bb1-6db74c28c808 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:57.645766 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 38/74] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:10:57 2022] GET /identity/v3/users/181490f42ff9443cbbe22f95fe330067 => generated 248 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:57.646346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb2897-92ff-41b0-9bb1-6db74c28c808 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:57.659088 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 37/75] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:57.660455 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0d87-027b-4b8b-8c76-d77a12416295 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.660746 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0d87-027b-4b8b-8c76-d77a12416295 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.661024 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0d87-027b-4b8b-8c76-d77a12416295 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.664173 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 38/76] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:10:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:10:57.665360 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0d87-027b-4b8b-8c76-d77a12416295 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:57.694898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:57.698353 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:57.750402 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb2897-92ff-41b0-9bb1-6db74c28c808 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:57.774353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0d87-027b-4b8b-8c76-d77a12416295 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:57.784707 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11da5c6-a498-402c-bafc-153a4d2e6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:57.785345 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da5c6-a498-402c-bafc-153a4d2e6547 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.785628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da5c6-a498-402c-bafc-153a4d2e6547 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.785908 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11da5c6-a498-402c-bafc-153a4d2e6547 None admin] PATH_INFO: `/v3/users/165fb0c8ef88466bbeca4d331d0775f0` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.800235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11da5c6-a498-402c-bafc-153a4d2e6547 None admin] RBAC: Authorizing `identity:get_user(user_id=165fb0c8ef88466bbeca4d331d0775f0)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:57.801702 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11da5c6-a498-402c-bafc-153a4d2e6547 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:57.803336 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 39/77] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:10:57 2022] GET /identity/v3/users/165fb0c8ef88466bbeca4d331d0775f0 => generated 276 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:57.804210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11da5c6-a498-402c-bafc-153a4d2e6547 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:57.810976 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99dde6-e3c4-43ca-89e2-d2eb8ed5a0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:57.811601 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99dde6-e3c4-43ca-89e2-d2eb8ed5a0ea None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.811882 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99dde6-e3c4-43ca-89e2-d2eb8ed5a0ea None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.812182 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99dde6-e3c4-43ca-89e2-d2eb8ed5a0ea None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.812903 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99dde6-e3c4-43ca-89e2-d2eb8ed5a0ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:57.813210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99dde6-e3c4-43ca-89e2-d2eb8ed5a0ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:57.814604 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99dde6-e3c4-43ca-89e2-d2eb8ed5a0ea None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:57.823266 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 39/78] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:10:57 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:57.824448 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed093e1a-74f4-4fc3-9b43-53183105a950 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.824735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed093e1a-74f4-4fc3-9b43-53183105a950 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.825012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed093e1a-74f4-4fc3-9b43-53183105a950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:57.843504 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-ed093e1a-74f4-4fc3-9b43-53183105a950 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:10:57.844747 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-ed093e1a-74f4-4fc3-9b43-53183105a950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:10:57.907155 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11da5c6-a498-402c-bafc-153a4d2e6547 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:57.909332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:57.914205 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 40/79] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:10:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:10:57.915830 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed093e1a-74f4-4fc3-9b43-53183105a950 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:57.934273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:57.941530 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e522f3-a427-42fd-b6b0-53bb2e8ba7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:57.942146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e522f3-a427-42fd-b6b0-53bb2e8ba7af None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:57.942434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e522f3-a427-42fd-b6b0-53bb2e8ba7af None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:57.942714 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e522f3-a427-42fd-b6b0-53bb2e8ba7af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.011417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e522f3-a427-42fd-b6b0-53bb2e8ba7af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:58.012930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e522f3-a427-42fd-b6b0-53bb2e8ba7af None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:58.017915 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed093e1a-74f4-4fc3-9b43-53183105a950 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.052848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f1d74-0c7b-4c6c-af17-1a5c59fa54ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:58.053501 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f1d74-0c7b-4c6c-af17-1a5c59fa54ba None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.053787 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f1d74-0c7b-4c6c-af17-1a5c59fa54ba None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.054065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f1d74-0c7b-4c6c-af17-1a5c59fa54ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.064205 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f1d74-0c7b-4c6c-af17-1a5c59fa54ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-0b7f1d74-0c7b-4c6c-af17-1a5c59fa54ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:10:58.069728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:10:58.070577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:10:58.071332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 41/80] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:10:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:10:58.071959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f1d74-0c7b-4c6c-af17-1a5c59fa54ba None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.113604 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 40/81] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:10:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:58.114453 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e522f3-a427-42fd-b6b0-53bb2e8ba7af None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.119664 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.154606 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.179352 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f1d74-0c7b-4c6c-af17-1a5c59fa54ba None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.216332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e522f3-a427-42fd-b6b0-53bb2e8ba7af None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.216527 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4fce1-21c7-417d-b7da-6bf8bcb8d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:58.217122 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4fce1-21c7-417d-b7da-6bf8bcb8d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.217409 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4fce1-21c7-417d-b7da-6bf8bcb8d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.217697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4fce1-21c7-417d-b7da-6bf8bcb8d2c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.250272 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef3a94-068b-404c-8cf8-c19d39ee28ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:58.250913 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3a94-068b-404c-8cf8-c19d39ee28ee None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.251203 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3a94-068b-404c-8cf8-c19d39ee28ee None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.251483 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef3a94-068b-404c-8cf8-c19d39ee28ee None admin] PATH_INFO: `/v3/users/165fb0c8ef88466bbeca4d331d0775f0` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.252716 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef3a94-068b-404c-8cf8-c19d39ee28ee None admin] RBAC: Authorizing `identity:get_user(user_id=165fb0c8ef88466bbeca4d331d0775f0)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:58.254173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef3a94-068b-404c-8cf8-c19d39ee28ee None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:58.259918 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 41/82] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:10:58 2022] GET /identity/v3/users/165fb0c8ef88466bbeca4d331d0775f0 => generated 276 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:58.259918 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef3a94-068b-404c-8cf8-c19d39ee28ee None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.290209 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4fce1-21c7-417d-b7da-6bf8bcb8d2c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:58.291718 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4fce1-21c7-417d-b7da-6bf8bcb8d2c2 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:58.332797 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.360546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef3a94-068b-404c-8cf8-c19d39ee28ee None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.369662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.393066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 42/83] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:10:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:58.393911 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4fce1-21c7-417d-b7da-6bf8bcb8d2c2 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.400151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766e66a-1f3d-434d-aede-e834e46a1e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:58.400920 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e66a-1f3d-434d-aede-e834e46a1e06 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.401208 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e66a-1f3d-434d-aede-e834e46a1e06 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.401484 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766e66a-1f3d-434d-aede-e834e46a1e06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.402725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766e66a-1f3d-434d-aede-e834e46a1e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:58.404196 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766e66a-1f3d-434d-aede-e834e46a1e06 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:58.405809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 42/84] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:10:58 2022] GET /identity/v3/domains/default => generated 200 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:58.407603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766e66a-1f3d-434d-aede-e834e46a1e06 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.494547 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4fce1-21c7-417d-b7da-6bf8bcb8d2c2 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.509642 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766e66a-1f3d-434d-aede-e834e46a1e06 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.530491 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb2265-0e1d-4d28-b07b-66bf87fd3bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:58.531147 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb2265-0e1d-4d28-b07b-66bf87fd3bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.531436 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb2265-0e1d-4d28-b07b-66bf87fd3bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.531721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb2265-0e1d-4d28-b07b-66bf87fd3bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.532478 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb2265-0e1d-4d28-b07b-66bf87fd3bf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:58.532791 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb2265-0e1d-4d28-b07b-66bf87fd3bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:58.534226 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb2265-0e1d-4d28-b07b-66bf87fd3bf2 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:58.543090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 43/85] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:10:58 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:58.544192 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb2265-0e1d-4d28-b07b-66bf87fd3bf2 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.548723 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6696a6b-4f06-4929-9951-a06dc02e92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:58.549375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696a6b-4f06-4929-9951-a06dc02e92a7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.549663 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696a6b-4f06-4929-9951-a06dc02e92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.549941 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696a6b-4f06-4929-9951-a06dc02e92a7 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.552373 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6696a6b-4f06-4929-9951-a06dc02e92a7 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:58.553728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6696a6b-4f06-4929-9951-a06dc02e92a7 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:58.555242 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 43/86] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:10:58 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:58.556026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6696a6b-4f06-4929-9951-a06dc02e92a7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.568597 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.588605 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.647769 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb2265-0e1d-4d28-b07b-66bf87fd3bf2 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.656026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6696a6b-4f06-4929-9951-a06dc02e92a7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.683575 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d1243-03ae-4db6-99c2-5c43c2eab179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:58.684225 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d1243-03ae-4db6-99c2-5c43c2eab179 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.684515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d1243-03ae-4db6-99c2-5c43c2eab179 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.684798 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d1243-03ae-4db6-99c2-5c43c2eab179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.690683 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9a4ea-63c3-4818-938f-c09c96889834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:58.691343 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a4ea-63c3-4818-938f-c09c96889834 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.691603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a4ea-63c3-4818-938f-c09c96889834 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.691883 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9a4ea-63c3-4818-938f-c09c96889834 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.693084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9a4ea-63c3-4818-938f-c09c96889834 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:58.694607 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9a4ea-63c3-4818-938f-c09c96889834 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:58.696306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 44/87] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:10:58 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:58.697061 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9a4ea-63c3-4818-938f-c09c96889834 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.763463 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d1243-03ae-4db6-99c2-5c43c2eab179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:58.764896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d1243-03ae-4db6-99c2-5c43c2eab179 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:58.777727 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.799821 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9a4ea-63c3-4818-938f-c09c96889834 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.804012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:58.833311 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b757e-18c9-4e19-9585-ac10acf6b14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:58.834016 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b757e-18c9-4e19-9585-ac10acf6b14f None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:58.834307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b757e-18c9-4e19-9585-ac10acf6b14f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:58.834588 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b757e-18c9-4e19-9585-ac10acf6b14f None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:58.835371 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b757e-18c9-4e19-9585-ac10acf6b14f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:58.836879 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b757e-18c9-4e19-9585-ac10acf6b14f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:58.863852 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 44/88] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:10:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:58.864880 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d1243-03ae-4db6-99c2-5c43c2eab179 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:58.963228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d1243-03ae-4db6-99c2-5c43c2eab179 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:58.975464 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 45/89] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:10:58 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:10:58.976138 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b757e-18c9-4e19-9585-ac10acf6b14f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:59.003444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de883b-515f-4528-b587-6a9bbb68366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:59.004136 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de883b-515f-4528-b587-6a9bbb68366d None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.004522 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de883b-515f-4528-b587-6a9bbb68366d None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.005181 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de883b-515f-4528-b587-6a9bbb68366d None admin] PATH_INFO: `/v3/users/165fb0c8ef88466bbeca4d331d0775f0` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.006262 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de883b-515f-4528-b587-6a9bbb68366d None admin] RBAC: Authorizing `identity:get_user(user_id=165fb0c8ef88466bbeca4d331d0775f0)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.007774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de883b-515f-4528-b587-6a9bbb68366d None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:59.014973 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 45/90] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:10:58 2022] GET /identity/v3/users/165fb0c8ef88466bbeca4d331d0775f0 => generated 276 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:59.014973 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de883b-515f-4528-b587-6a9bbb68366d None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:59.024592 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:59.113284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b757e-18c9-4e19-9585-ac10acf6b14f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:59.134115 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de883b-515f-4528-b587-6a9bbb68366d None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:59.144352 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:59.149935 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139804a3-b8d3-4413-a48e-5ec4489c614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:59.150573 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139804a3-b8d3-4413-a48e-5ec4489c614d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.150865 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139804a3-b8d3-4413-a48e-5ec4489c614d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.151148 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139804a3-b8d3-4413-a48e-5ec4489c614d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.152294 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139804a3-b8d3-4413-a48e-5ec4489c614d None admin] RBAC: Adding query filter params (role.id=6d23401ca57e47398bf036ea320a7617, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9, user.id=181490f42ff9443cbbe22f95fe330067) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:59.152294 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139804a3-b8d3-4413-a48e-5ec4489c614d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.153827 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139804a3-b8d3-4413-a48e-5ec4489c614d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:59.160834 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 46/91] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:10:58 2022] GET /identity/v3/role_assignments?user.id=181490f42ff9443cbbe22f95fe330067&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=6d23401ca57e47398bf036ea320a7617 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:59.162136 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139804a3-b8d3-4413-a48e-5ec4489c614d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:59.180038 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970132e8-e7d1-49d0-be65-317ac71a5dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:59.180872 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970132e8-e7d1-49d0-be65-317ac71a5dd7 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.181262 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970132e8-e7d1-49d0-be65-317ac71a5dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.182218 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970132e8-e7d1-49d0-be65-317ac71a5dd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.182389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970132e8-e7d1-49d0-be65-317ac71a5dd7 None admin] RBAC: Adding query filter params (role.id=7b33619ed33f41c0b797124afa4a385d, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9, user.id=165fb0c8ef88466bbeca4d331d0775f0) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:59.182723 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970132e8-e7d1-49d0-be65-317ac71a5dd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.185194 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970132e8-e7d1-49d0-be65-317ac71a5dd7 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:59.193008 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 46/92] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:10:59 2022] GET /identity/v3/role_assignments?user.id=165fb0c8ef88466bbeca4d331d0775f0&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=7b33619ed33f41c0b797124afa4a385d => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:59.197222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970132e8-e7d1-49d0-be65-317ac71a5dd7 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:59.309375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139804a3-b8d3-4413-a48e-5ec4489c614d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:59.309547 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:59.361080 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b0899-592a-494b-a70b-025c298fadc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:59.361979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b0899-592a-494b-a70b-025c298fadc8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.362266 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b0899-592a-494b-a70b-025c298fadc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.362544 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b0899-592a-494b-a70b-025c298fadc8 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.364350 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970132e8-e7d1-49d0-be65-317ac71a5dd7 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:59.364748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b0899-592a-494b-a70b-025c298fadc8 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.366342 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b0899-592a-494b-a70b-025c298fadc8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:59.368764 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 47/93] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:10:59 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:59.376165 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b0899-592a-494b-a70b-025c298fadc8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:59.415332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a357577-663e-4db7-ad86-fa76106e6510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:59.416048 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a357577-663e-4db7-ad86-fa76106e6510 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.416454 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a357577-663e-4db7-ad86-fa76106e6510 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.416734 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a357577-663e-4db7-ad86-fa76106e6510 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.478559 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:59.527378 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a357577-663e-4db7-ad86-fa76106e6510 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.529088 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a357577-663e-4db7-ad86-fa76106e6510 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:59.533947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b0899-592a-494b-a70b-025c298fadc8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:59.576600 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19356f1a-aa23-471d-a8c3-56c8e4b65726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:59.577561 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19356f1a-aa23-471d-a8c3-56c8e4b65726 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.578041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19356f1a-aa23-471d-a8c3-56c8e4b65726 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.578511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19356f1a-aa23-471d-a8c3-56c8e4b65726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.579523 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19356f1a-aa23-471d-a8c3-56c8e4b65726 None admin] RBAC: Adding query filter params (role.id=11db0567e2634cbb9e76b190bddd6e2a, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9, user.id=165fb0c8ef88466bbeca4d331d0775f0) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:10:59.580029 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19356f1a-aa23-471d-a8c3-56c8e4b65726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.582017 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19356f1a-aa23-471d-a8c3-56c8e4b65726 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:59.590035 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 48/94] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:10:59 2022] GET /identity/v3/role_assignments?user.id=165fb0c8ef88466bbeca4d331d0775f0&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=11db0567e2634cbb9e76b190bddd6e2a => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:59.632515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:59.661244 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 47/95] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:10:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:59.667405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19356f1a-aa23-471d-a8c3-56c8e4b65726 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:10:59.789886 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19356f1a-aa23-471d-a8c3-56c8e4b65726 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:10:59.820745 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:59.829832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e4efe-66b1-48db-8e3c-a3a2a731994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:10:59.830931 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4efe-66b1-48db-8e3c-a3a2a731994b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:10:59.831374 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4efe-66b1-48db-8e3c-a3a2a731994b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:10:59.831806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4efe-66b1-48db-8e3c-a3a2a731994b None admin] PATH_INFO: `/v3/projects/7a25d58eecb842c0b9f80bb302bfe3df` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:10:59.833193 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e4efe-66b1-48db-8e3c-a3a2a731994b None admin] RBAC: Authorizing `identity:get_project(project_id=7a25d58eecb842c0b9f80bb302bfe3df)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:10:59.834846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e4efe-66b1-48db-8e3c-a3a2a731994b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:10:59.839962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 49/96] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:10:59 2022] GET /identity/v3/projects/7a25d58eecb842c0b9f80bb302bfe3df => generated 313 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:10:59.846746 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a357577-663e-4db7-ad86-fa76106e6510 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:00.030948 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a357577-663e-4db7-ad86-fa76106e6510 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:00.076443 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfad5dd-79ab-4e26-b9f9-ddab27a0136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:00.077396 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfad5dd-79ab-4e26-b9f9-ddab27a0136a None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:00.077861 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfad5dd-79ab-4e26-b9f9-ddab27a0136a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:00.078310 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfad5dd-79ab-4e26-b9f9-ddab27a0136a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:00.079268 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfad5dd-79ab-4e26-b9f9-ddab27a0136a None admin] RBAC: Adding query filter params (role.id=7b33619ed33f41c0b797124afa4a385d, scope.project.id=7a25d58eecb842c0b9f80bb302bfe3df, user.id=165fb0c8ef88466bbeca4d331d0775f0) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:00.079919 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfad5dd-79ab-4e26-b9f9-ddab27a0136a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:00.081620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfad5dd-79ab-4e26-b9f9-ddab27a0136a None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:00.092721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 48/97] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:10:59 2022] GET /identity/v3/role_assignments?user.id=165fb0c8ef88466bbeca4d331d0775f0&scope.project.id=7a25d58eecb842c0b9f80bb302bfe3df&role.id=7b33619ed33f41c0b797124afa4a385d => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:02.074258 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0ac9-cfae-4b9f-a78a-de4105dd1116 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.074773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0ac9-cfae-4b9f-a78a-de4105dd1116 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.074884 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c0ac9-cfae-4b9f-a78a-de4105dd1116 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.076198 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 50/98] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:02.081508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c7eff-1730-49d1-b7a4-c18532d500d8 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.081918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c7eff-1730-49d1-b7a4-c18532d500d8 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.082086 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c7eff-1730-49d1-b7a4-c18532d500d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.100664 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-7a2c7eff-1730-49d1-b7a4-c18532d500d8 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:02.101865 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-7a2c7eff-1730-49d1-b7a4-c18532d500d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:02.131405 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:02.189647 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 49/99] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:02.231834 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c0ac9-cfae-4b9f-a78a-de4105dd1116 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:02.355351 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c0ac9-cfae-4b9f-a78a-de4105dd1116 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:02.392928 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf319d-5745-429b-bde7-251224916ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:02.393927 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf319d-5745-429b-bde7-251224916ccc None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.394426 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf319d-5745-429b-bde7-251224916ccc None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.394894 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf319d-5745-429b-bde7-251224916ccc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.405951 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf319d-5745-429b-bde7-251224916ccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-e0bf319d-5745-429b-bde7-251224916ccc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:02.411682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:02.413078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:02.413839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:02.416145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 51/100] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:02.422238 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c7eff-1730-49d1-b7a4-c18532d500d8 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:02.546732 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c7eff-1730-49d1-b7a4-c18532d500d8 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:02.548761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1f81-72c1-4bf7-82b6-32964517e534 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.549253 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1f81-72c1-4bf7-82b6-32964517e534 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.549722 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1f81-72c1-4bf7-82b6-32964517e534 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.551254 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 52/101] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:02.556763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a950a-fd5b-41ac-9827-772785a7a5b2 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.557413 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a950a-fd5b-41ac-9827-772785a7a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.557886 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a950a-fd5b-41ac-9827-772785a7a5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.597399 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-4c3a950a-fd5b-41ac-9827-772785a7a5b2 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:02.598606 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-4c3a950a-fd5b-41ac-9827-772785a7a5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:02.614689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a7048-b2e4-40e3-a7b7-e9defc3cef18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:02.616195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a7048-b2e4-40e3-a7b7-e9defc3cef18 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.616700 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a7048-b2e4-40e3-a7b7-e9defc3cef18 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.617168 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a7048-b2e4-40e3-a7b7-e9defc3cef18 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.618639 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a7048-b2e4-40e3-a7b7-e9defc3cef18 None admin] RBAC: Adding query filter params (name=member) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:02.619168 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a7048-b2e4-40e3-a7b7-e9defc3cef18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:02.620813 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a7048-b2e4-40e3-a7b7-e9defc3cef18 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:02.632525 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 50/102] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:02 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:02.634547 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81e66-8eb8-4e73-b916-6c1afaec4b6f None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.635055 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81e66-8eb8-4e73-b916-6c1afaec4b6f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.635901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f81e66-8eb8-4e73-b916-6c1afaec4b6f None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.637323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 51/103] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:02.638184 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81e66-8eb8-4e73-b916-6c1afaec4b6f None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:02.690157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:02.716489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:02.742229 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 53/104] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:02.743653 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb99a22-7b0b-4b38-9964-3a33d0765498 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.743948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb99a22-7b0b-4b38-9964-3a33d0765498 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.744254 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb99a22-7b0b-4b38-9964-3a33d0765498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.780675 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-ccb99a22-7b0b-4b38-9964-3a33d0765498 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:02.781946 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-ccb99a22-7b0b-4b38-9964-3a33d0765498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:02.862163 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f81e66-8eb8-4e73-b916-6c1afaec4b6f None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:02.893002 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 54/105] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:02.894257 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb99a22-7b0b-4b38-9964-3a33d0765498 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:02.917103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c393623-ec6a-4e33-985b-1a325fb594fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:02.918169 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c393623-ec6a-4e33-985b-1a325fb594fd None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:02.918557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c393623-ec6a-4e33-985b-1a325fb594fd None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:02.918959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c393623-ec6a-4e33-985b-1a325fb594fd None admin] PATH_INFO: `/v3/users/165fb0c8ef88466bbeca4d331d0775f0` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:02.920277 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c393623-ec6a-4e33-985b-1a325fb594fd None admin] RBAC: Authorizing `identity:get_user(user_id=165fb0c8ef88466bbeca4d331d0775f0)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:02.921836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c393623-ec6a-4e33-985b-1a325fb594fd None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:02.923551 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 52/106] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:02 2022] GET /identity/v3/users/165fb0c8ef88466bbeca4d331d0775f0 => generated 276 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:02.929103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c393623-ec6a-4e33-985b-1a325fb594fd None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:03.107556 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:03.116650 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c393623-ec6a-4e33-985b-1a325fb594fd None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:03.130167 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb99a22-7b0b-4b38-9964-3a33d0765498 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:03.149695 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:03.164363 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e01b-47b9-4ded-b924-203788625489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:03.170165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e01b-47b9-4ded-b924-203788625489 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.170165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e01b-47b9-4ded-b924-203788625489 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.170165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e01b-47b9-4ded-b924-203788625489 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.170165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e01b-47b9-4ded-b924-203788625489 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:03.170165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e01b-47b9-4ded-b924-203788625489 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:03.172394 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 53/107] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:02 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:03.172937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcbbc2-8b5c-4286-9901-bbbf8b5c238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:03.173331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e01b-47b9-4ded-b924-203788625489 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:03.174005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcbbc2-8b5c-4286-9901-bbbf8b5c238e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.174481 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcbbc2-8b5c-4286-9901-bbbf8b5c238e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.174960 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcbbc2-8b5c-4286-9901-bbbf8b5c238e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.187915 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcbbc2-8b5c-4286-9901-bbbf8b5c238e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-aabcbbc2-8b5c-4286-9901-bbbf8b5c238e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:03.194274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:03.195177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:03.195930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:03.198359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 55/108] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:11:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:03.199884 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c0947-d735-4282-9819-f3937cf52cf9 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.200396 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c0947-d735-4282-9819-f3937cf52cf9 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.200910 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c0947-d735-4282-9819-f3937cf52cf9 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.202414 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 56/109] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:03.207424 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c0947-d735-4282-9819-f3937cf52cf9 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:03.294942 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e01b-47b9-4ded-b924-203788625489 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:03.318401 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c0947-d735-4282-9819-f3937cf52cf9 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:03.333152 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceadee-fac5-4d8c-b06a-68324a4ec45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:03.333996 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceadee-fac5-4d8c-b06a-68324a4ec45e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.334384 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceadee-fac5-4d8c-b06a-68324a4ec45e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.334788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceadee-fac5-4d8c-b06a-68324a4ec45e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.345879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ceadee-fac5-4d8c-b06a-68324a4ec45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-57ceadee-fac5-4d8c-b06a-68324a4ec45e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:03.351524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:03.352543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 54/110] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:03.356826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceadee-fac5-4d8c-b06a-68324a4ec45e None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:03.369445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1eb78-8960-4b53-b0cc-c005b8c9f220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:03.370133 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1eb78-8960-4b53-b0cc-c005b8c9f220 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.370439 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1eb78-8960-4b53-b0cc-c005b8c9f220 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.370700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1eb78-8960-4b53-b0cc-c005b8c9f220 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/users/165fb0c8ef88466bbeca4d331d0775f0/roles/7b33619ed33f41c0b797124afa4a385d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.372725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1eb78-8960-4b53-b0cc-c005b8c9f220 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0c05ddb694f492bb5fecdd464e933c9, user_id=165fb0c8ef88466bbeca4d331d0775f0, role_id=7b33619ed33f41c0b797124afa4a385d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:03.374230 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1eb78-8960-4b53-b0cc-c005b8c9f220 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:03.389184 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:03.479835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceadee-fac5-4d8c-b06a-68324a4ec45e None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:03.500490 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 57/111] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:11:03 2022] PUT /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/users/165fb0c8ef88466bbeca4d331d0775f0/roles/7b33619ed33f41c0b797124afa4a385d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:03.502138 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f33d40-6363-49df-bcd2-d7be61861826 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.502630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f33d40-6363-49df-bcd2-d7be61861826 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.503104 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f33d40-6363-49df-bcd2-d7be61861826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.527390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727b000-ce63-499e-b147-ceccfd0e18d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:03.528042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727b000-ce63-499e-b147-ceccfd0e18d7 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.528358 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727b000-ce63-499e-b147-ceccfd0e18d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.528638 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727b000-ce63-499e-b147-ceccfd0e18d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.529145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-06f33d40-6363-49df-bcd2-d7be61861826 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:03.530266 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727b000-ce63-499e-b147-ceccfd0e18d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:03.530266 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727b000-ce63-499e-b147-ceccfd0e18d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:03.531047 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-06f33d40-6363-49df-bcd2-d7be61861826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:03.531320 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727b000-ce63-499e-b147-ceccfd0e18d7 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:03.542391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 55/112] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:03 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:03.542391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac1f3a-0494-49ae-bfdb-484f15c8d895 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.542391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac1f3a-0494-49ae-bfdb-484f15c8d895 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.542391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac1f3a-0494-49ae-bfdb-484f15c8d895 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.542391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 56/113] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:03.547099 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac1f3a-0494-49ae-bfdb-484f15c8d895 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:03.581335 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:03.640845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 58/114] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:03.642196 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f33d40-6363-49df-bcd2-d7be61861826 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:03.680835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:03.704646 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac1f3a-0494-49ae-bfdb-484f15c8d895 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:03.744420 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb33eb0-be61-43bd-a38e-cdc6fab31639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:03.745111 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33eb0-be61-43bd-a38e-cdc6fab31639 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.745440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33eb0-be61-43bd-a38e-cdc6fab31639 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.745775 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33eb0-be61-43bd-a38e-cdc6fab31639 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.746612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb33eb0-be61-43bd-a38e-cdc6fab31639 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:03.747026 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb33eb0-be61-43bd-a38e-cdc6fab31639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:03.748440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb33eb0-be61-43bd-a38e-cdc6fab31639 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:03.757588 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 57/115] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:03 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:03.758810 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d5c09-6c79-4470-8f49-649c8c82eb17 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.759100 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d5c09-6c79-4470-8f49-649c8c82eb17 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.759377 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d5c09-6c79-4470-8f49-649c8c82eb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.778973 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f33d40-6363-49df-bcd2-d7be61861826 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:03.780594 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-282d5c09-6c79-4470-8f49-649c8c82eb17 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:03.781787 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-282d5c09-6c79-4470-8f49-649c8c82eb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:03.816560 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45983bc1-f2f8-4cd7-9ad2-7ec7db925b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:03.817212 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45983bc1-f2f8-4cd7-9ad2-7ec7db925b87 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.824236 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45983bc1-f2f8-4cd7-9ad2-7ec7db925b87 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.824236 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45983bc1-f2f8-4cd7-9ad2-7ec7db925b87 None admin] PATH_INFO: `/v3/users/181490f42ff9443cbbe22f95fe330067` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.824236 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45983bc1-f2f8-4cd7-9ad2-7ec7db925b87 None admin] RBAC: Authorizing `identity:get_user(user_id=181490f42ff9443cbbe22f95fe330067)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:03.824236 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45983bc1-f2f8-4cd7-9ad2-7ec7db925b87 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:03.824236 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 59/116] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:03 2022] GET /identity/v3/users/181490f42ff9443cbbe22f95fe330067 => generated 248 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:03.824236 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45983bc1-f2f8-4cd7-9ad2-7ec7db925b87 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:03.858581 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 58/117] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:03.859451 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d5c09-6c79-4470-8f49-649c8c82eb17 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:03.866281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:03.942331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:03.945326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45983bc1-f2f8-4cd7-9ad2-7ec7db925b87 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:03.966010 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d5c09-6c79-4470-8f49-649c8c82eb17 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:03.981254 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f2aac-bb39-43cd-bd57-5197ddd9688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:03.981898 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2aac-bb39-43cd-bd57-5197ddd9688d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:03.982186 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2aac-bb39-43cd-bd57-5197ddd9688d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:03.982468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f2aac-bb39-43cd-bd57-5197ddd9688d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:03.993187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f2aac-bb39-43cd-bd57-5197ddd9688d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-190f2aac-bb39-43cd-bd57-5197ddd9688d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:03.998219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:03.999062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:03.999868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 60/118] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:04.000976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c543c-34bb-4cdd-9a0f-9612b8ab56ed None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.001299 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c543c-34bb-4cdd-9a0f-9612b8ab56ed None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.001394 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c543c-34bb-4cdd-9a0f-9612b8ab56ed None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.006726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 61/119] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:03 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:04.006726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c543c-34bb-4cdd-9a0f-9612b8ab56ed None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.012017 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd052db-7a93-4104-8009-180e21edf77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:04.012716 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd052db-7a93-4104-8009-180e21edf77c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.013004 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd052db-7a93-4104-8009-180e21edf77c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.013285 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd052db-7a93-4104-8009-180e21edf77c None admin] PATH_INFO: `/v3/users/bf4b61afaaca4766aea68825c3a5f69a` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.028498 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd052db-7a93-4104-8009-180e21edf77c None admin] RBAC: Authorizing `identity:get_user(user_id=bf4b61afaaca4766aea68825c3a5f69a)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:04.030093 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd052db-7a93-4104-8009-180e21edf77c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:04.032129 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 59/120] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:03 2022] GET /identity/v3/users/bf4b61afaaca4766aea68825c3a5f69a => generated 290 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:04.038303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd052db-7a93-4104-8009-180e21edf77c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.105747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:04.114024 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c543c-34bb-4cdd-9a0f-9612b8ab56ed None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:04.148529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a459ce5-9eac-4b52-a92c-159805df35d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:04.149194 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459ce5-9eac-4b52-a92c-159805df35d5 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.149440 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459ce5-9eac-4b52-a92c-159805df35d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.149716 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459ce5-9eac-4b52-a92c-159805df35d5 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.150889 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a459ce5-9eac-4b52-a92c-159805df35d5 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:04.152406 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a459ce5-9eac-4b52-a92c-159805df35d5 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:04.159044 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 62/121] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:04 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:04.159172 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd052db-7a93-4104-8009-180e21edf77c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:04.159551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a459ce5-9eac-4b52-a92c-159805df35d5 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.195419 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f86bcc-c5dd-4a62-a292-444a3157f624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:04.196392 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f86bcc-c5dd-4a62-a292-444a3157f624 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.196885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f86bcc-c5dd-4a62-a292-444a3157f624 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.197340 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f86bcc-c5dd-4a62-a292-444a3157f624 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.198678 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f86bcc-c5dd-4a62-a292-444a3157f624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:04.200487 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f86bcc-c5dd-4a62-a292-444a3157f624 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:04.202388 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 60/122] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:04 2022] GET /identity/v3/domains/default => generated 200 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:04.203771 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f003f-be1d-4948-99be-6a1ca17c1a3f None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.204057 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f003f-be1d-4948-99be-6a1ca17c1a3f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.204367 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f003f-be1d-4948-99be-6a1ca17c1a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.211369 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:04.224614 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-3a7f003f-be1d-4948-99be-6a1ca17c1a3f None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:04.226066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-3a7f003f-be1d-4948-99be-6a1ca17c1a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:04.269828 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a459ce5-9eac-4b52-a92c-159805df35d5 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:04.300479 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 61/123] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:04.301356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f003f-be1d-4948-99be-6a1ca17c1a3f None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.315626 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170dbb-f9c2-49bb-a1c3-9bc32006a3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:04.316279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170dbb-f9c2-49bb-a1c3-9bc32006a3a8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.316559 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170dbb-f9c2-49bb-a1c3-9bc32006a3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.316836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75170dbb-f9c2-49bb-a1c3-9bc32006a3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.317620 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170dbb-f9c2-49bb-a1c3-9bc32006a3a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:04.317927 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170dbb-f9c2-49bb-a1c3-9bc32006a3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:04.319592 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75170dbb-f9c2-49bb-a1c3-9bc32006a3a8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:04.329646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 63/124] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:04 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:04.330742 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170dbb-f9c2-49bb-a1c3-9bc32006a3a8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.358195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:04.415056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f003f-be1d-4948-99be-6a1ca17c1a3f None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:04.441857 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75170dbb-f9c2-49bb-a1c3-9bc32006a3a8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:04.446715 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:04.451940 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0848-fb0e-464e-9d14-3f18726773fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:04.453022 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0848-fb0e-464e-9d14-3f18726773fc None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.453316 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0848-fb0e-464e-9d14-3f18726773fc None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.453600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee0848-fb0e-464e-9d14-3f18726773fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.479339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa695a2-55a8-4bfc-8802-71cc11246002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:04.480017 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa695a2-55a8-4bfc-8802-71cc11246002 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.480334 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa695a2-55a8-4bfc-8802-71cc11246002 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.480613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa695a2-55a8-4bfc-8802-71cc11246002 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/users/181490f42ff9443cbbe22f95fe330067/roles/6d23401ca57e47398bf036ea320a7617` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.482721 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa695a2-55a8-4bfc-8802-71cc11246002 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0c05ddb694f492bb5fecdd464e933c9, user_id=181490f42ff9443cbbe22f95fe330067, role_id=6d23401ca57e47398bf036ea320a7617)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:04.484216 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa695a2-55a8-4bfc-8802-71cc11246002 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:04.533210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee0848-fb0e-464e-9d14-3f18726773fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:04.534628 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee0848-fb0e-464e-9d14-3f18726773fc None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:04.623249 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 64/125] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:11:04 2022] PUT /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/users/181490f42ff9443cbbe22f95fe330067/roles/6d23401ca57e47398bf036ea320a7617 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:04.624551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa695a2-55a8-4bfc-8802-71cc11246002 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.643967 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 62/126] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:04 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:04.645322 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0848-fb0e-464e-9d14-3f18726773fc None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.688469 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:04.748967 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:04.767615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee0848-fb0e-464e-9d14-3f18726773fc None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:04.774928 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa695a2-55a8-4bfc-8802-71cc11246002 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:04.811854 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698cf9a-e5dd-41cb-a829-c60e01cedfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:04.812898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698cf9a-e5dd-41cb-a829-c60e01cedfd6 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.813483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698cf9a-e5dd-41cb-a829-c60e01cedfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.814505 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698cf9a-e5dd-41cb-a829-c60e01cedfd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.816504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773230ff-76e0-4e4d-9cd3-2cd2617507aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:04.817235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773230ff-76e0-4e4d-9cd3-2cd2617507aa None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:04.817595 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773230ff-76e0-4e4d-9cd3-2cd2617507aa None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:04.818104 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773230ff-76e0-4e4d-9cd3-2cd2617507aa None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:04.818732 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773230ff-76e0-4e4d-9cd3-2cd2617507aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:04.820331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773230ff-76e0-4e4d-9cd3-2cd2617507aa None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:04.829342 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698cf9a-e5dd-41cb-a829-c60e01cedfd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-7698cf9a-e5dd-41cb-a829-c60e01cedfd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:04.835489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:04.836422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:04.837203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:04.844493 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 63/127] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:04.846935 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698cf9a-e5dd-41cb-a829-c60e01cedfd6 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.919516 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 65/128] 10.222.0.100 () {60 vars in 1146 bytes} [Tue Jul 26 15:11:04 2022] POST /identity/v3/projects => generated 303 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:04.925644 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773230ff-76e0-4e4d-9cd3-2cd2617507aa None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:04.962935 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698cf9a-e5dd-41cb-a829-c60e01cedfd6 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.000604 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:05.007518 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558dea-1ca8-492f-a361-0ae56c2e7701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.008311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558dea-1ca8-492f-a361-0ae56c2e7701 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.008602 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558dea-1ca8-492f-a361-0ae56c2e7701 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.008885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e558dea-1ca8-492f-a361-0ae56c2e7701 None admin] PATH_INFO: `/v3/users/165fb0c8ef88466bbeca4d331d0775f0` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.010140 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558dea-1ca8-492f-a361-0ae56c2e7701 None admin] RBAC: Authorizing `identity:get_user(user_id=165fb0c8ef88466bbeca4d331d0775f0)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.011650 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e558dea-1ca8-492f-a361-0ae56c2e7701 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.014249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 64/129] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:04 2022] GET /identity/v3/users/165fb0c8ef88466bbeca4d331d0775f0 => generated 276 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:05.014911 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558dea-1ca8-492f-a361-0ae56c2e7701 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.136232 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e558dea-1ca8-492f-a361-0ae56c2e7701 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.162720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773230ff-76e0-4e4d-9cd3-2cd2617507aa None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.167998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbcd17-33b8-4e68-93e2-20adcd6203dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.172528 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbcd17-33b8-4e68-93e2-20adcd6203dc None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.172528 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbcd17-33b8-4e68-93e2-20adcd6203dc None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.172528 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbcd17-33b8-4e68-93e2-20adcd6203dc None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.172528 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbcd17-33b8-4e68-93e2-20adcd6203dc None admin] RBAC: Adding query filter params (name=member) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:05.172528 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbcd17-33b8-4e68-93e2-20adcd6203dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.172528 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbcd17-33b8-4e68-93e2-20adcd6203dc None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.188759 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 65/130] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:05 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:05.188759 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbcd17-33b8-4e68-93e2-20adcd6203dc None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.228583 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:05.233799 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247daf-6175-484d-a81c-32c97d419dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.234738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247daf-6175-484d-a81c-32c97d419dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.235245 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247daf-6175-484d-a81c-32c97d419dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.235819 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247daf-6175-484d-a81c-32c97d419dc1 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.239258 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247daf-6175-484d-a81c-32c97d419dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.241607 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247daf-6175-484d-a81c-32c97d419dc1 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.243539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 66/131] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:04 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:05.248735 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247daf-6175-484d-a81c-32c97d419dc1 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.255626 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:05.302065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbcd17-33b8-4e68-93e2-20adcd6203dc None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.339738 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0db74-09e4-4371-9093-6b23f1b41de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.340801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0db74-09e4-4371-9093-6b23f1b41de8 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.341289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0db74-09e4-4371-9093-6b23f1b41de8 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.341786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0db74-09e4-4371-9093-6b23f1b41de8 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.343177 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0db74-09e4-4371-9093-6b23f1b41de8 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.345271 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0db74-09e4-4371-9093-6b23f1b41de8 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.347597 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 66/132] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:05 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:05.348709 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0db74-09e4-4371-9093-6b23f1b41de8 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.367921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247daf-6175-484d-a81c-32c97d419dc1 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.420531 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fac046-3fbd-43cf-9a86-ae7493666e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.421127 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fac046-3fbd-43cf-9a86-ae7493666e8f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.421412 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fac046-3fbd-43cf-9a86-ae7493666e8f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.421691 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fac046-3fbd-43cf-9a86-ae7493666e8f None admin] PATH_INFO: `/v3/users/165fb0c8ef88466bbeca4d331d0775f0` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.424466 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fac046-3fbd-43cf-9a86-ae7493666e8f None admin] RBAC: Authorizing `identity:get_user(user_id=165fb0c8ef88466bbeca4d331d0775f0)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.425895 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fac046-3fbd-43cf-9a86-ae7493666e8f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.427711 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 67/133] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:05 2022] GET /identity/v3/users/165fb0c8ef88466bbeca4d331d0775f0 => generated 276 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:05.429385 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fac046-3fbd-43cf-9a86-ae7493666e8f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.491407 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:05.503592 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0db74-09e4-4371-9093-6b23f1b41de8 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.523725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:05.552283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fa8af-d6ae-4b81-86f1-f6afb1445780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.552947 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fa8af-d6ae-4b81-86f1-f6afb1445780 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.553245 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fa8af-d6ae-4b81-86f1-f6afb1445780 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.553487 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fa8af-d6ae-4b81-86f1-f6afb1445780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.554582 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fa8af-d6ae-4b81-86f1-f6afb1445780 None admin] RBAC: Adding query filter params (role.id=4ff172ce2b424a9589c1730145dd135e, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9, user.id=bf4b61afaaca4766aea68825c3a5f69a) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:05.554582 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fa8af-d6ae-4b81-86f1-f6afb1445780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.556046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fa8af-d6ae-4b81-86f1-f6afb1445780 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.562220 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 67/134] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:05 2022] GET /identity/v3/role_assignments?user.id=bf4b61afaaca4766aea68825c3a5f69a&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=4ff172ce2b424a9589c1730145dd135e => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:05.565621 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fac046-3fbd-43cf-9a86-ae7493666e8f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.569169 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fa8af-d6ae-4b81-86f1-f6afb1445780 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.654221 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b971480-aa27-4c32-b22f-be71e5f1a5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.654905 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b971480-aa27-4c32-b22f-be71e5f1a5fd None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.655194 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b971480-aa27-4c32-b22f-be71e5f1a5fd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.655478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b971480-aa27-4c32-b22f-be71e5f1a5fd None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/users/165fb0c8ef88466bbeca4d331d0775f0/roles/11db0567e2634cbb9e76b190bddd6e2a` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.659944 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b971480-aa27-4c32-b22f-be71e5f1a5fd None admin] RBAC: Authorizing `identity:create_grant(project_id=b0c05ddb694f492bb5fecdd464e933c9, user_id=165fb0c8ef88466bbeca4d331d0775f0, role_id=11db0567e2634cbb9e76b190bddd6e2a)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.661445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b971480-aa27-4c32-b22f-be71e5f1a5fd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.777022 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fa8af-d6ae-4b81-86f1-f6afb1445780 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:05.796076 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 68/135] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:11:05 2022] PUT /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/users/165fb0c8ef88466bbeca4d331d0775f0/roles/11db0567e2634cbb9e76b190bddd6e2a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:05.833898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba38ed2-ac17-4efe-95e1-7143ee9d6297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:05.834611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba38ed2-ac17-4efe-95e1-7143ee9d6297 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:05.834881 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba38ed2-ac17-4efe-95e1-7143ee9d6297 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:05.835164 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba38ed2-ac17-4efe-95e1-7143ee9d6297 None admin] PATH_INFO: `/v3/projects/7a25d58eecb842c0b9f80bb302bfe3df` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:05.836651 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba38ed2-ac17-4efe-95e1-7143ee9d6297 None admin] RBAC: Authorizing `identity:get_project(project_id=7a25d58eecb842c0b9f80bb302bfe3df)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:05.838281 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba38ed2-ac17-4efe-95e1-7143ee9d6297 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:05.840174 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 68/136] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:05 2022] GET /identity/v3/projects/7a25d58eecb842c0b9f80bb302bfe3df => generated 313 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:05.846574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b971480-aa27-4c32-b22f-be71e5f1a5fd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:05.986731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b971480-aa27-4c32-b22f-be71e5f1a5fd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:06.020049 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:06.025631 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69202b6f-ffcd-4fff-91b9-1079e831d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:06.026683 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69202b6f-ffcd-4fff-91b9-1079e831d2a1 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.027094 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69202b6f-ffcd-4fff-91b9-1079e831d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.027381 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69202b6f-ffcd-4fff-91b9-1079e831d2a1 None admin] PATH_INFO: `/v3/projects/7a25d58eecb842c0b9f80bb302bfe3df/users/165fb0c8ef88466bbeca4d331d0775f0/roles/7b33619ed33f41c0b797124afa4a385d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.029652 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69202b6f-ffcd-4fff-91b9-1079e831d2a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a25d58eecb842c0b9f80bb302bfe3df, user_id=165fb0c8ef88466bbeca4d331d0775f0, role_id=7b33619ed33f41c0b797124afa4a385d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:06.031191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69202b6f-ffcd-4fff-91b9-1079e831d2a1 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.069777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054813d4-6221-48e7-8557-dc1521bf0faa None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.070176 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054813d4-6221-48e7-8557-dc1521bf0faa None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.070672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054813d4-6221-48e7-8557-dc1521bf0faa None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.072607 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 69/137] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:06.079988 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7443bc8-8090-4779-ae0c-bd9c6b2b356c None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.080468 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7443bc8-8090-4779-ae0c-bd9c6b2b356c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.080851 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7443bc8-8090-4779-ae0c-bd9c6b2b356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.101785 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-f7443bc8-8090-4779-ae0c-bd9c6b2b356c None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:06.103230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f7443bc8-8090-4779-ae0c-bd9c6b2b356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:06.125550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:06.152170 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 69/138] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:11:05 2022] PUT /identity/v3/projects/7a25d58eecb842c0b9f80bb302bfe3df/users/165fb0c8ef88466bbeca4d331d0775f0/roles/7b33619ed33f41c0b797124afa4a385d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:06.190646 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 70/139] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:06.216999 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69202b6f-ffcd-4fff-91b9-1079e831d2a1 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.360769 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69202b6f-ffcd-4fff-91b9-1079e831d2a1 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:06.413869 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14bc5e-6ebc-4c20-8ade-6722a703050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:06.414772 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14bc5e-6ebc-4c20-8ade-6722a703050e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.415205 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14bc5e-6ebc-4c20-8ade-6722a703050e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.415630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14bc5e-6ebc-4c20-8ade-6722a703050e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.433861 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14bc5e-6ebc-4c20-8ade-6722a703050e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-ad14bc5e-6ebc-4c20-8ade-6722a703050e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:06.439738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:06.440846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:06.441809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:06.443833 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 70/140] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:06.450131 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7443bc8-8090-4779-ae0c-bd9c6b2b356c None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.604883 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7443bc8-8090-4779-ae0c-bd9c6b2b356c None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:06.656900 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e39ef-9eaf-49a8-b0ac-c4a7b51e788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:06.657779 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e39ef-9eaf-49a8-b0ac-c4a7b51e788a None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.658210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e39ef-9eaf-49a8-b0ac-c4a7b51e788a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.658629 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e39ef-9eaf-49a8-b0ac-c4a7b51e788a None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.659512 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e39ef-9eaf-49a8-b0ac-c4a7b51e788a None admin] RBAC: Adding query filter params (name=member) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:06.659963 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e39ef-9eaf-49a8-b0ac-c4a7b51e788a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:06.662077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e39ef-9eaf-49a8-b0ac-c4a7b51e788a None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.671630 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 71/141] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:06 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:06.678023 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14bc5e-6ebc-4c20-8ade-6722a703050e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.739148 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:06.799259 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14bc5e-6ebc-4c20-8ade-6722a703050e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:06.845161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4931852-da90-41a5-98bb-30dbd54eeb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:06.845825 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4931852-da90-41a5-98bb-30dbd54eeb71 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:06.846114 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4931852-da90-41a5-98bb-30dbd54eeb71 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:06.846398 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4931852-da90-41a5-98bb-30dbd54eeb71 None admin] PATH_INFO: `/v3/users/165fb0c8ef88466bbeca4d331d0775f0` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:06.847608 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4931852-da90-41a5-98bb-30dbd54eeb71 None admin] RBAC: Authorizing `identity:get_user(user_id=165fb0c8ef88466bbeca4d331d0775f0)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:06.849694 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4931852-da90-41a5-98bb-30dbd54eeb71 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:06.851634 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 71/142] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:06 2022] GET /identity/v3/users/165fb0c8ef88466bbeca4d331d0775f0 => generated 276 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:06.856888 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e39ef-9eaf-49a8-b0ac-c4a7b51e788a None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:06.873960 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:06.989290 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e39ef-9eaf-49a8-b0ac-c4a7b51e788a None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:07.034092 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73e1b6-5813-49a7-8472-398b1f58c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:07.034725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e1b6-5813-49a7-8472-398b1f58c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:07.035010 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e1b6-5813-49a7-8472-398b1f58c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:07.035292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e1b6-5813-49a7-8472-398b1f58c0f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:07.117584 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73e1b6-5813-49a7-8472-398b1f58c0f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:07.119095 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73e1b6-5813-49a7-8472-398b1f58c0f9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:07.134736 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:07.260996 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 72/143] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:06 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:07.266114 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4931852-da90-41a5-98bb-30dbd54eeb71 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:07.403369 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4931852-da90-41a5-98bb-30dbd54eeb71 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:07.425088 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:07.444105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93e59f-e11d-4a04-8041-a39ca8dbdb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:07.445073 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93e59f-e11d-4a04-8041-a39ca8dbdb50 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:07.445660 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93e59f-e11d-4a04-8041-a39ca8dbdb50 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:07.446134 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93e59f-e11d-4a04-8041-a39ca8dbdb50 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:07.452903 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93e59f-e11d-4a04-8041-a39ca8dbdb50 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:07.454937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93e59f-e11d-4a04-8041-a39ca8dbdb50 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:07.456924 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 72/144] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:07 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:07.463290 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73e1b6-5813-49a7-8472-398b1f58c0f9 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:07.522781 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c50f6a-0be7-4a59-bceb-c79d3393a970 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:07.523450 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c50f6a-0be7-4a59-bceb-c79d3393a970 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:07.523935 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c50f6a-0be7-4a59-bceb-c79d3393a970 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:07.525472 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 73/145] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:07.545776 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd4551-17d1-4d65-86a8-cc9a667b402d None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:07.546374 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd4551-17d1-4d65-86a8-cc9a667b402d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:07.546847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd4551-17d1-4d65-86a8-cc9a667b402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:07.577114 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-02bd4551-17d1-4d65-86a8-cc9a667b402d None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:07.578661 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-02bd4551-17d1-4d65-86a8-cc9a667b402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:07.686352 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73e1b6-5813-49a7-8472-398b1f58c0f9 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:07.699985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 74/146] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:07.713309 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:07.744322 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd4551-17d1-4d65-86a8-cc9a667b402d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:07.748834 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf6338-37f4-4062-be95-e430227d8eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:07.749538 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf6338-37f4-4062-be95-e430227d8eae None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:07.749827 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf6338-37f4-4062-be95-e430227d8eae None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:07.750108 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf6338-37f4-4062-be95-e430227d8eae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:07.750918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf6338-37f4-4062-be95-e430227d8eae None admin] RBAC: Adding query filter params (role.id=7b33619ed33f41c0b797124afa4a385d, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9, user.id=165fb0c8ef88466bbeca4d331d0775f0) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:07.751241 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf6338-37f4-4062-be95-e430227d8eae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:07.752754 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf6338-37f4-4062-be95-e430227d8eae None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:07.759896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 73/147] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:07 2022] GET /identity/v3/role_assignments?user.id=165fb0c8ef88466bbeca4d331d0775f0&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=7b33619ed33f41c0b797124afa4a385d => generated 610 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:07.909143 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd4551-17d1-4d65-86a8-cc9a667b402d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:07.936020 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:07.957135 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee18b3-b841-48d4-b2a9-fbfeaa7221c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:07.957806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee18b3-b841-48d4-b2a9-fbfeaa7221c6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:07.958091 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee18b3-b841-48d4-b2a9-fbfeaa7221c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:07.958987 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee18b3-b841-48d4-b2a9-fbfeaa7221c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:07.980155 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee18b3-b841-48d4-b2a9-fbfeaa7221c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-4eee18b3-b841-48d4-b2a9-fbfeaa7221c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:07.982461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:07.983304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:07.984065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:07.986625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 75/148] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:07.997224 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf6338-37f4-4062-be95-e430227d8eae None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:08.144978 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf6338-37f4-4062-be95-e430227d8eae None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:08.181519 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20776c-3a0c-45ff-9471-c7d289befb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:08.182100 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20776c-3a0c-45ff-9471-c7d289befb88 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:08.182387 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20776c-3a0c-45ff-9471-c7d289befb88 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:08.182667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20776c-3a0c-45ff-9471-c7d289befb88 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:08.183390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20776c-3a0c-45ff-9471-c7d289befb88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:08.183699 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20776c-3a0c-45ff-9471-c7d289befb88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:08.185134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20776c-3a0c-45ff-9471-c7d289befb88 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:08.194550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 74/149] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:07 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:08.200339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee18b3-b841-48d4-b2a9-fbfeaa7221c6 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:08.367475 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee18b3-b841-48d4-b2a9-fbfeaa7221c6 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:08.474363 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5ca51-6677-43b6-af9e-7e8d46abd08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:08.484145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5ca51-6677-43b6-af9e-7e8d46abd08f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:08.484145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5ca51-6677-43b6-af9e-7e8d46abd08f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:08.484145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5ca51-6677-43b6-af9e-7e8d46abd08f None admin] PATH_INFO: `/v3/users/181490f42ff9443cbbe22f95fe330067` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:08.490899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5ca51-6677-43b6-af9e-7e8d46abd08f None admin] RBAC: Authorizing `identity:get_user(user_id=181490f42ff9443cbbe22f95fe330067)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:08.492595 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5ca51-6677-43b6-af9e-7e8d46abd08f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:08.494495 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 76/150] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:08 2022] GET /identity/v3/users/181490f42ff9443cbbe22f95fe330067 => generated 248 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:08.549607 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20776c-3a0c-45ff-9471-c7d289befb88 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:08.644504 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:08.742252 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20776c-3a0c-45ff-9471-c7d289befb88 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:08.758289 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265d145-1e37-42c9-8b93-346d17a90348 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:08.758571 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265d145-1e37-42c9-8b93-346d17a90348 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:08.759348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265d145-1e37-42c9-8b93-346d17a90348 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:08.761087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 77/151] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:08 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:08.774272 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f235-e84b-4a34-b5ae-6dc4ccd1d41f None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:08.774896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f235-e84b-4a34-b5ae-6dc4ccd1d41f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:08.775373 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f235-e84b-4a34-b5ae-6dc4ccd1d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:08.796757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-0839f235-e84b-4a34-b5ae-6dc4ccd1d41f None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:08.798280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-0839f235-e84b-4a34-b5ae-6dc4ccd1d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:08.881673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce6537-deaf-4d86-9fad-53e19de10094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:08.882609 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6537-deaf-4d86-9fad-53e19de10094 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:08.883044 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6537-deaf-4d86-9fad-53e19de10094 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:08.883542 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce6537-deaf-4d86-9fad-53e19de10094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:08.898014 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:08.948819 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 78/152] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:08.992047 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce6537-deaf-4d86-9fad-53e19de10094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:08.993648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce6537-deaf-4d86-9fad-53e19de10094 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:09.001816 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f235-e84b-4a34-b5ae-6dc4ccd1d41f None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:09.076551 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:09.163500 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f235-e84b-4a34-b5ae-6dc4ccd1d41f None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:09.198770 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244d86f-a691-4705-9858-2b5baa57d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:09.199427 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d86f-a691-4705-9858-2b5baa57d81b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.199716 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d86f-a691-4705-9858-2b5baa57d81b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.199996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244d86f-a691-4705-9858-2b5baa57d81b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.201190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244d86f-a691-4705-9858-2b5baa57d81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:09.202662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244d86f-a691-4705-9858-2b5baa57d81b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:09.204304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 79/153] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:09 2022] GET /identity/v3/domains/default => generated 200 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:09.205831 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 75/154] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:09.214196 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282789-ec33-429f-931a-3c389612acf0 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.214482 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282789-ec33-429f-931a-3c389612acf0 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.214764 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282789-ec33-429f-931a-3c389612acf0 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.215129 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce6537-deaf-4d86-9fad-53e19de10094 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:09.216164 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 80/155] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:09.219193 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5282789-ec33-429f-931a-3c389612acf0 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:09.271323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:09.334627 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5282789-ec33-429f-931a-3c389612acf0 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:09.346628 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce6537-deaf-4d86-9fad-53e19de10094 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:09.382287 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006765ca-a78f-453a-8c00-124fd8ea7e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:09.383751 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006765ca-a78f-453a-8c00-124fd8ea7e24 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.384284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006765ca-a78f-453a-8c00-124fd8ea7e24 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.384759 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006765ca-a78f-453a-8c00-124fd8ea7e24 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.386242 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006765ca-a78f-453a-8c00-124fd8ea7e24 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:09.388022 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006765ca-a78f-453a-8c00-124fd8ea7e24 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:09.390467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 81/156] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:09 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:09.390955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7abc66-0d8a-48bb-a4ee-3c8726abacb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:09.391588 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7abc66-0d8a-48bb-a4ee-3c8726abacb8 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.391871 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7abc66-0d8a-48bb-a4ee-3c8726abacb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.392163 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7abc66-0d8a-48bb-a4ee-3c8726abacb8 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.392835 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb433775-9637-42d7-8771-0f7fdf4f109a None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.392938 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7abc66-0d8a-48bb-a4ee-3c8726abacb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:09.393402 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb433775-9637-42d7-8771-0f7fdf4f109a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.393869 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb433775-9637-42d7-8771-0f7fdf4f109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.394299 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7abc66-0d8a-48bb-a4ee-3c8726abacb8 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:09.412532 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:09.415022 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-cb433775-9637-42d7-8771-0f7fdf4f109a None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:09.416427 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-cb433775-9637-42d7-8771-0f7fdf4f109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:09.486487 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 76/157] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:11:09 2022] POST /identity/v3/users => generated 284 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:09.487374 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7abc66-0d8a-48bb-a4ee-3c8726abacb8 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:09.498793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 82/158] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:09.500255 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc1a23-9a5f-4b60-a8e8-a04aab649840 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.500550 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc1a23-9a5f-4b60-a8e8-a04aab649840 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.500891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc1a23-9a5f-4b60-a8e8-a04aab649840 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.504562 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 83/159] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:09.509757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3fe4-3256-472f-902c-7b4fa70f5a48 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.509757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3fe4-3256-472f-902c-7b4fa70f5a48 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.510535 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3fe4-3256-472f-902c-7b4fa70f5a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.535569 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-874d3fe4-3256-472f-902c-7b4fa70f5a48 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:09.536781 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-874d3fe4-3256-472f-902c-7b4fa70f5a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:09.579985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:09.618843 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 84/160] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:09.620438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a6804-4a9a-439e-86cb-e74d6489c995 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.620725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a6804-4a9a-439e-86cb-e74d6489c995 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.621001 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a6804-4a9a-439e-86cb-e74d6489c995 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.622301 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 85/161] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:09.623013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a6804-4a9a-439e-86cb-e74d6489c995 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:09.647473 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7abc66-0d8a-48bb-a4ee-3c8726abacb8 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:09.689641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0c2ab-3bd1-47f4-bf21-f664ce045482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:09.690279 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0c2ab-3bd1-47f4-bf21-f664ce045482 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.690560 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0c2ab-3bd1-47f4-bf21-f664ce045482 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.691515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0c2ab-3bd1-47f4-bf21-f664ce045482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.691630 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0c2ab-3bd1-47f4-bf21-f664ce045482 None admin] RBAC: Adding query filter params (role.id=6d23401ca57e47398bf036ea320a7617, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9, user.id=181490f42ff9443cbbe22f95fe330067) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:09.691926 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0c2ab-3bd1-47f4-bf21-f664ce045482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:09.693906 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0c2ab-3bd1-47f4-bf21-f664ce045482 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:09.706521 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 77/162] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:09 2022] GET /identity/v3/role_assignments?user.id=181490f42ff9443cbbe22f95fe330067&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=6d23401ca57e47398bf036ea320a7617 => generated 610 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:09.706521 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eddb8-5a70-4eb3-a38a-27065a218e90 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.706521 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eddb8-5a70-4eb3-a38a-27065a218e90 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.706521 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eddb8-5a70-4eb3-a38a-27065a218e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.728887 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-706eddb8-5a70-4eb3-a38a-27065a218e90 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:09.730123 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-706eddb8-5a70-4eb3-a38a-27065a218e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:09.765070 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a6804-4a9a-439e-86cb-e74d6489c995 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:09.815336 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:09.821161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d9f7a-8b44-4aad-aff9-57ab30143443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:09.822000 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d9f7a-8b44-4aad-aff9-57ab30143443 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:09.822298 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d9f7a-8b44-4aad-aff9-57ab30143443 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:09.822574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d9f7a-8b44-4aad-aff9-57ab30143443 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:09.828438 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 78/163] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:09.829601 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eddb8-5a70-4eb3-a38a-27065a218e90 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:09.843229 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d9f7a-8b44-4aad-aff9-57ab30143443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-7d8d9f7a-8b44-4aad-aff9-57ab30143443 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:09.848763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:09.849731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:09.850511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 86/164] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:09.856619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d9f7a-8b44-4aad-aff9-57ab30143443 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:09.903366 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:09.969247 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eddb8-5a70-4eb3-a38a-27065a218e90 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:09.995285 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d9f7a-8b44-4aad-aff9-57ab30143443 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.019096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c134-0ecf-46d0-aa81-f7dbb0c6db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.020183 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c134-0ecf-46d0-aa81-f7dbb0c6db46 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.022325 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c134-0ecf-46d0-aa81-f7dbb0c6db46 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.022325 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2c134-0ecf-46d0-aa81-f7dbb0c6db46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.033231 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2c134-0ecf-46d0-aa81-f7dbb0c6db46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-0ae2c134-0ecf-46d0-aa81-f7dbb0c6db46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:10.038731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:10.039587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:10.040430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 79/165] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:10.041262 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c134-0ecf-46d0-aa81-f7dbb0c6db46 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.049759 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e7b68-f874-4846-9db2-baf9618c9554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.050602 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7b68-f874-4846-9db2-baf9618c9554 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.051023 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7b68-f874-4846-9db2-baf9618c9554 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.051434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7b68-f874-4846-9db2-baf9618c9554 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.052882 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7b68-f874-4846-9db2-baf9618c9554 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:10.053325 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7b68-f874-4846-9db2-baf9618c9554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.054871 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7b68-f874-4846-9db2-baf9618c9554 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.064198 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 87/166] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:09 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:10.065286 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e7b68-f874-4846-9db2-baf9618c9554 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.111479 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:10.181513 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2c134-0ecf-46d0-aa81-f7dbb0c6db46 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.199318 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:10.206606 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e7b68-f874-4846-9db2-baf9618c9554 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.228462 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b6038-8887-4142-a3a1-ffa35278bfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.229124 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6038-8887-4142-a3a1-ffa35278bfce None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.229409 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6038-8887-4142-a3a1-ffa35278bfce None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.229689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6038-8887-4142-a3a1-ffa35278bfce None admin] PATH_INFO: `/v3/roles/member` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.245807 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b6038-8887-4142-a3a1-ffa35278bfce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-2a7b6038-8887-4142-a3a1-ffa35278bfce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:10.251331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:10.252359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:10.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:10.253780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac1b53-c686-47ab-bb0c-49fe5e5e00ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.253780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac1b53-c686-47ab-bb0c-49fe5e5e00ac None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.253780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac1b53-c686-47ab-bb0c-49fe5e5e00ac None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.253780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac1b53-c686-47ab-bb0c-49fe5e5e00ac None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.254026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac1b53-c686-47ab-bb0c-49fe5e5e00ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:10.254643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac1b53-c686-47ab-bb0c-49fe5e5e00ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.255834 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac1b53-c686-47ab-bb0c-49fe5e5e00ac None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.256355 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 80/167] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:10.257479 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b6038-8887-4142-a3a1-ffa35278bfce None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.265551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 88/168] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:10 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:10.266415 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac1b53-c686-47ab-bb0c-49fe5e5e00ac None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.371947 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b6038-8887-4142-a3a1-ffa35278bfce None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.383691 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:10.392988 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac1b53-c686-47ab-bb0c-49fe5e5e00ac None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.435278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dbf0a-d074-4eeb-9dc4-3f8e47e46374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.435940 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dbf0a-d074-4eeb-9dc4-3f8e47e46374 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.436249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dbf0a-d074-4eeb-9dc4-3f8e47e46374 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.436527 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dbf0a-d074-4eeb-9dc4-3f8e47e46374 None admin] PATH_INFO: `/v3/users/bf4b61afaaca4766aea68825c3a5f69a` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.437864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5dbf0a-d074-4eeb-9dc4-3f8e47e46374 None admin] RBAC: Authorizing `identity:get_user(user_id=bf4b61afaaca4766aea68825c3a5f69a)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.440336 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5dbf0a-d074-4eeb-9dc4-3f8e47e46374 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.441975 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 81/169] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:10 2022] GET /identity/v3/users/bf4b61afaaca4766aea68825c3a5f69a => generated 290 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:10.442787 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dbf0a-d074-4eeb-9dc4-3f8e47e46374 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.459753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb6da9-8c45-403b-b5ce-b1b933db7d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.460414 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6da9-8c45-403b-b5ce-b1b933db7d95 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.460746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6da9-8c45-403b-b5ce-b1b933db7d95 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.461025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6da9-8c45-403b-b5ce-b1b933db7d95 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.461750 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb6da9-8c45-403b-b5ce-b1b933db7d95 None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:10.463611 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb6da9-8c45-403b-b5ce-b1b933db7d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.465331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb6da9-8c45-403b-b5ce-b1b933db7d95 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.482897 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 89/170] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:10 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:10.483770 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb6da9-8c45-403b-b5ce-b1b933db7d95 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.533094 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:10.626367 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dbf0a-d074-4eeb-9dc4-3f8e47e46374 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.665964 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb6da9-8c45-403b-b5ce-b1b933db7d95 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.704063 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb43f4-5fbd-44eb-8a7c-1c411623d891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.704748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb43f4-5fbd-44eb-8a7c-1c411623d891 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.705015 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb43f4-5fbd-44eb-8a7c-1c411623d891 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.705292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb43f4-5fbd-44eb-8a7c-1c411623d891 None admin] PATH_INFO: `/v3/users/165fb0c8ef88466bbeca4d331d0775f0` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.707589 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb43f4-5fbd-44eb-8a7c-1c411623d891 None admin] RBAC: Authorizing `identity:get_user(user_id=165fb0c8ef88466bbeca4d331d0775f0)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.709112 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb43f4-5fbd-44eb-8a7c-1c411623d891 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.711715 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 82/171] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:10 2022] GET /identity/v3/users/165fb0c8ef88466bbeca4d331d0775f0 => generated 276 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:10.714365 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb43f4-5fbd-44eb-8a7c-1c411623d891 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.730168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3a77-b257-4618-8ba7-50fa48ab2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.730855 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3a77-b257-4618-8ba7-50fa48ab2e29 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.731138 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3a77-b257-4618-8ba7-50fa48ab2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.731410 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a3a77-b257-4618-8ba7-50fa48ab2e29 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.734222 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a3a77-b257-4618-8ba7-50fa48ab2e29 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.735860 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a3a77-b257-4618-8ba7-50fa48ab2e29 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.741251 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 90/172] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:10 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:10.742107 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3a77-b257-4618-8ba7-50fa48ab2e29 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:10.819151 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:10.882231 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:10.906644 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a3a77-b257-4618-8ba7-50fa48ab2e29 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.913141 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb43f4-5fbd-44eb-8a7c-1c411623d891 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:10.969847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7396da-39f3-4847-8632-b3f3e19e4827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.971337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7396da-39f3-4847-8632-b3f3e19e4827 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.972757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7396da-39f3-4847-8632-b3f3e19e4827 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.973585 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ce2f0-c152-4dc8-bab3-a3b88c3ff94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:10.974623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7396da-39f3-4847-8632-b3f3e19e4827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.976045 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ce2f0-c152-4dc8-bab3-a3b88c3ff94f None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:10.976878 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ce2f0-c152-4dc8-bab3-a3b88c3ff94f None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:10.978713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ce2f0-c152-4dc8-bab3-a3b88c3ff94f None admin] PATH_INFO: `/v3/users/165fb0c8ef88466bbeca4d331d0775f0` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:10.980811 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ce2f0-c152-4dc8-bab3-a3b88c3ff94f None admin] RBAC: Authorizing `identity:get_user(user_id=165fb0c8ef88466bbeca4d331d0775f0)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:10.983218 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ce2f0-c152-4dc8-bab3-a3b88c3ff94f None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:10.990863 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 83/173] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:10 2022] GET /identity/v3/users/165fb0c8ef88466bbeca4d331d0775f0 => generated 276 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:10.991866 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ce2f0-c152-4dc8-bab3-a3b88c3ff94f None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.092622 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7396da-39f3-4847-8632-b3f3e19e4827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.094104 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7396da-39f3-4847-8632-b3f3e19e4827 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.143337 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ce2f0-c152-4dc8-bab3-a3b88c3ff94f None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.158459 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.193198 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.197449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af983e-facf-4d2d-836c-b22276892371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.198156 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af983e-facf-4d2d-836c-b22276892371 None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.198445 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af983e-facf-4d2d-836c-b22276892371 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.198728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af983e-facf-4d2d-836c-b22276892371 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/users/bf4b61afaaca4766aea68825c3a5f69a/roles/4ff172ce2b424a9589c1730145dd135e` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.200782 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af983e-facf-4d2d-836c-b22276892371 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0c05ddb694f492bb5fecdd464e933c9, user_id=bf4b61afaaca4766aea68825c3a5f69a, role_id=4ff172ce2b424a9589c1730145dd135e)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.202263 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af983e-facf-4d2d-836c-b22276892371 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.203024 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 91/174] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:11.203930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7396da-39f3-4847-8632-b3f3e19e4827 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.315140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7396da-39f3-4847-8632-b3f3e19e4827 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.360892 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0e0d5-6333-4b0b-a95c-f8eb47b449db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.361536 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0e0d5-6333-4b0b-a95c-f8eb47b449db None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.361818 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0e0d5-6333-4b0b-a95c-f8eb47b449db None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.362094 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0e0d5-6333-4b0b-a95c-f8eb47b449db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.378256 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 84/175] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:11:10 2022] PUT /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/users/bf4b61afaaca4766aea68825c3a5f69a/roles/4ff172ce2b424a9589c1730145dd135e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:11.379125 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af983e-facf-4d2d-836c-b22276892371 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.468501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.508982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0e0d5-6333-4b0b-a95c-f8eb47b449db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.510475 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0e0d5-6333-4b0b-a95c-f8eb47b449db None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.634377 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af983e-facf-4d2d-836c-b22276892371 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.705621 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 92/176] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:11.712871 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0e0d5-6333-4b0b-a95c-f8eb47b449db None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.732955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accf299-13fd-4965-9b5f-c96da516775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.733571 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf299-13fd-4965-9b5f-c96da516775b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.733803 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf299-13fd-4965-9b5f-c96da516775b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.734080 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf299-13fd-4965-9b5f-c96da516775b None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.735273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accf299-13fd-4965-9b5f-c96da516775b None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.736821 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accf299-13fd-4965-9b5f-c96da516775b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.738512 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 85/177] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:11 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:11.747067 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accf299-13fd-4965-9b5f-c96da516775b None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:11.821576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.862855 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.889544 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0e0d5-6333-4b0b-a95c-f8eb47b449db None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.893011 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accf299-13fd-4965-9b5f-c96da516775b None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:11.930570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158a43a-8146-4dc5-9f36-5e3a08b430a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.931203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158a43a-8146-4dc5-9f36-5e3a08b430a1 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.931487 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158a43a-8146-4dc5-9f36-5e3a08b430a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.931761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158a43a-8146-4dc5-9f36-5e3a08b430a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.932683 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158a43a-8146-4dc5-9f36-5e3a08b430a1 None admin] RBAC: Adding query filter params (role.id=11db0567e2634cbb9e76b190bddd6e2a, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9, user.id=165fb0c8ef88466bbeca4d331d0775f0) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:11.932998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158a43a-8146-4dc5-9f36-5e3a08b430a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.934683 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158a43a-8146-4dc5-9f36-5e3a08b430a1 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.940968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 86/178] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:11 2022] GET /identity/v3/role_assignments?user.id=165fb0c8ef88466bbeca4d331d0775f0&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=11db0567e2634cbb9e76b190bddd6e2a => generated 610 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:11.944723 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58475f3-de94-45fb-8cbd-6058624d77bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:11.945389 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58475f3-de94-45fb-8cbd-6058624d77bb None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:11.945671 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58475f3-de94-45fb-8cbd-6058624d77bb None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:11.945950 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58475f3-de94-45fb-8cbd-6058624d77bb None admin] PATH_INFO: `/v3/projects/7a25d58eecb842c0b9f80bb302bfe3df` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:11.953148 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58475f3-de94-45fb-8cbd-6058624d77bb None admin] RBAC: Authorizing `identity:get_project(project_id=7a25d58eecb842c0b9f80bb302bfe3df)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:11.954678 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58475f3-de94-45fb-8cbd-6058624d77bb None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:11.956928 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 93/179] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:11 2022] GET /identity/v3/projects/7a25d58eecb842c0b9f80bb302bfe3df => generated 313 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:11.963076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158a43a-8146-4dc5-9f36-5e3a08b430a1 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:12.110480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158a43a-8146-4dc5-9f36-5e3a08b430a1 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:12.117959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:12.150028 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ea191-1dfd-4078-ba9a-fcc6071ed7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:12.150672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea191-1dfd-4078-ba9a-fcc6071ed7ef None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:12.150959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea191-1dfd-4078-ba9a-fcc6071ed7ef None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:12.151236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea191-1dfd-4078-ba9a-fcc6071ed7ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:12.152033 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ea191-1dfd-4078-ba9a-fcc6071ed7ef None admin] RBAC: Adding query filter params (role.id=7b33619ed33f41c0b797124afa4a385d, scope.project.id=7a25d58eecb842c0b9f80bb302bfe3df, user.id=165fb0c8ef88466bbeca4d331d0775f0) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:12.152384 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ea191-1dfd-4078-ba9a-fcc6071ed7ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:12.153848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ea191-1dfd-4078-ba9a-fcc6071ed7ef None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:12.160344 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 87/180] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:11 2022] GET /identity/v3/role_assignments?user.id=165fb0c8ef88466bbeca4d331d0775f0&scope.project.id=7a25d58eecb842c0b9f80bb302bfe3df&role.id=7b33619ed33f41c0b797124afa4a385d => generated 610 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:12.502823 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f390-62e5-4566-b5cf-42b8075a5db8 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:12.503326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f390-62e5-4566-b5cf-42b8075a5db8 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:12.503399 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494f390-62e5-4566-b5cf-42b8075a5db8 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:12.505053 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 94/181] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:12.510106 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320e37-b3d1-40ae-b4eb-b853939bb1b3 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:12.510400 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320e37-b3d1-40ae-b4eb-b853939bb1b3 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:12.510679 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320e37-b3d1-40ae-b4eb-b853939bb1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:12.532451 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-96320e37-b3d1-40ae-b4eb-b853939bb1b3 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:12.533655 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-96320e37-b3d1-40ae-b4eb-b853939bb1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:12.622870 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 88/182] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:12.670605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494f390-62e5-4566-b5cf-42b8075a5db8 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:12.780663 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494f390-62e5-4566-b5cf-42b8075a5db8 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:12.816136 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6844c-5a73-4ee3-8e6a-93f3ad89b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:12.816850 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6844c-5a73-4ee3-8e6a-93f3ad89b653 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:12.817197 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6844c-5a73-4ee3-8e6a-93f3ad89b653 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:12.817951 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6844c-5a73-4ee3-8e6a-93f3ad89b653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:12.830168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6844c-5a73-4ee3-8e6a-93f3ad89b653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-16b6844c-5a73-4ee3-8e6a-93f3ad89b653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:12.835743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:12.836737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:12.837539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 95/183] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:12.842721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d786-00b2-457a-94a9-4db864b68465 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:12.843231 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6844c-5a73-4ee3-8e6a-93f3ad89b653 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:12.843785 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d786-00b2-457a-94a9-4db864b68465 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:12.844405 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d786-00b2-457a-94a9-4db864b68465 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:12.846071 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 89/184] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:12 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:12.852518 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc335a-0ebb-42a0-95cb-8bfbb7b1e8fb None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:12.852871 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc335a-0ebb-42a0-95cb-8bfbb7b1e8fb None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:12.853252 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc335a-0ebb-42a0-95cb-8bfbb7b1e8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:12.955453 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-14cc335a-0ebb-42a0-95cb-8bfbb7b1e8fb None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:12.957103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:12.957870 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-14cc335a-0ebb-42a0-95cb-8bfbb7b1e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:13.040183 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 90/185] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:13.041581 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c946425-3608-4b64-aeb1-db98b488aa4d None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:13.042674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c946425-3608-4b64-aeb1-db98b488aa4d None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:13.042977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c946425-3608-4b64-aeb1-db98b488aa4d None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:13.044768 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 91/186] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:13.050272 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011219e6-d1b2-4bc2-99a4-9651eae9ac80 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:13.050541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011219e6-d1b2-4bc2-99a4-9651eae9ac80 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:13.050820 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011219e6-d1b2-4bc2-99a4-9651eae9ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:13.060367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6844c-5a73-4ee3-8e6a-93f3ad89b653 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:13.070391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-011219e6-d1b2-4bc2-99a4-9651eae9ac80 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:13.071583 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-011219e6-d1b2-4bc2-99a4-9651eae9ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:13.097815 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803158c-fbe5-49a6-92ea-63b423a0d07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:13.098362 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:13.098557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803158c-fbe5-49a6-92ea-63b423a0d07b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:13.098734 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803158c-fbe5-49a6-92ea-63b423a0d07b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:13.099013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803158c-fbe5-49a6-92ea-63b423a0d07b None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:13.099742 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803158c-fbe5-49a6-92ea-63b423a0d07b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:13.100054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803158c-fbe5-49a6-92ea-63b423a0d07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:13.101501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803158c-fbe5-49a6-92ea-63b423a0d07b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:13.110732 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 96/187] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:12 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:13.114696 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803158c-fbe5-49a6-92ea-63b423a0d07b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:13.147955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 92/188] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:13.156577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011219e6-d1b2-4bc2-99a4-9651eae9ac80 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:13.201512 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:13.224671 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803158c-fbe5-49a6-92ea-63b423a0d07b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:13.261911 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b636e-c10c-49e5-a6f7-acd138ee38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:13.262554 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b636e-c10c-49e5-a6f7-acd138ee38d2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:13.262841 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b636e-c10c-49e5-a6f7-acd138ee38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:13.263124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b636e-c10c-49e5-a6f7-acd138ee38d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:13.271348 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011219e6-d1b2-4bc2-99a4-9651eae9ac80 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:13.273831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b636e-c10c-49e5-a6f7-acd138ee38d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-165b636e-c10c-49e5-a6f7-acd138ee38d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:13.279191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:13.280388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:13.281458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 97/189] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:13.282282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b636e-c10c-49e5-a6f7-acd138ee38d2 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:13.315126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095db673-9a02-460b-a0ac-16a16690aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:13.315719 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095db673-9a02-460b-a0ac-16a16690aa6e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:13.316005 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095db673-9a02-460b-a0ac-16a16690aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:13.316319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095db673-9a02-460b-a0ac-16a16690aa6e None admin] PATH_INFO: `/v3/users/bb7d4b7d8809451b8855c45f013fa87c` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:13.332921 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095db673-9a02-460b-a0ac-16a16690aa6e None admin] RBAC: Authorizing `identity:get_user(user_id=bb7d4b7d8809451b8855c45f013fa87c)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:13.335617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095db673-9a02-460b-a0ac-16a16690aa6e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:13.337389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 93/190] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:13 2022] GET /identity/v3/users/bb7d4b7d8809451b8855c45f013fa87c => generated 284 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:13.338170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095db673-9a02-460b-a0ac-16a16690aa6e None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:13.360521 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:13.415451 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b636e-c10c-49e5-a6f7-acd138ee38d2 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:13.453622 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a045c5-fda5-4a15-bde8-df85e79c7099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:13.454262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a045c5-fda5-4a15-bde8-df85e79c7099 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:13.454551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a045c5-fda5-4a15-bde8-df85e79c7099 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:13.454655 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095db673-9a02-460b-a0ac-16a16690aa6e None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:13.454826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a045c5-fda5-4a15-bde8-df85e79c7099 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:13.456056 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a045c5-fda5-4a15-bde8-df85e79c7099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:13.457555 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a045c5-fda5-4a15-bde8-df85e79c7099 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:13.459467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 98/191] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:13.460017 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a045c5-fda5-4a15-bde8-df85e79c7099 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:13.467395 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:13.509313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e8a4-80ee-413f-9797-4ab08bfdadb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:13.509935 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e8a4-80ee-413f-9797-4ab08bfdadb8 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:13.510215 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e8a4-80ee-413f-9797-4ab08bfdadb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:13.510491 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737e8a4-80ee-413f-9797-4ab08bfdadb8 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:13.511198 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e8a4-80ee-413f-9797-4ab08bfdadb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:13.511499 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e8a4-80ee-413f-9797-4ab08bfdadb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:13.512929 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737e8a4-80ee-413f-9797-4ab08bfdadb8 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:13.521768 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 94/192] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:13 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:13.527168 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e8a4-80ee-413f-9797-4ab08bfdadb8 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:13.605219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a045c5-fda5-4a15-bde8-df85e79c7099 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:13.636978 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:13.648591 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074294e8-04b5-434b-90ba-46652c4be4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:13.649199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074294e8-04b5-434b-90ba-46652c4be4bf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:13.649524 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074294e8-04b5-434b-90ba-46652c4be4bf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:13.649756 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074294e8-04b5-434b-90ba-46652c4be4bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:13.655800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737e8a4-80ee-413f-9797-4ab08bfdadb8 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:13.692085 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07d07-acc8-4e95-bf57-41611222bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:13.692796 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07d07-acc8-4e95-bf57-41611222bdc9 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:13.693056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07d07-acc8-4e95-bf57-41611222bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:13.693329 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07d07-acc8-4e95-bf57-41611222bdc9 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:13.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e07d07-acc8-4e95-bf57-41611222bdc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:13.695460 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e07d07-acc8-4e95-bf57-41611222bdc9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:13.720617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074294e8-04b5-434b-90ba-46652c4be4bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:13.724164 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074294e8-04b5-434b-90ba-46652c4be4bf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:13.725421 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:13.821301 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 99/193] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:13.822123 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074294e8-04b5-434b-90ba-46652c4be4bf None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:13.842805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 95/194] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:11:13 2022] POST /identity/v3/users => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:13.844326 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07d07-acc8-4e95-bf57-41611222bdc9 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:13.949844 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074294e8-04b5-434b-90ba-46652c4be4bf None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:13.953340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:13.991089 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff766aa-15a7-4946-92f5-41a349ab2af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:13.991809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff766aa-15a7-4946-92f5-41a349ab2af0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:13.992098 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff766aa-15a7-4946-92f5-41a349ab2af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:13.992418 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff766aa-15a7-4946-92f5-41a349ab2af0 None admin] PATH_INFO: `/v3/users/bb7d4b7d8809451b8855c45f013fa87c` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:13.993664 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff766aa-15a7-4946-92f5-41a349ab2af0 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7d4b7d8809451b8855c45f013fa87c)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:13.995155 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff766aa-15a7-4946-92f5-41a349ab2af0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:13.995369 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07d07-acc8-4e95-bf57-41611222bdc9 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:13.997369 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 100/195] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:13 2022] GET /identity/v3/users/bb7d4b7d8809451b8855c45f013fa87c => generated 284 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:14.005796 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff766aa-15a7-4946-92f5-41a349ab2af0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:14.058603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72bca5-44eb-4c7a-95b0-9117e6e6c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:14.059318 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72bca5-44eb-4c7a-95b0-9117e6e6c65f None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:14.059672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72bca5-44eb-4c7a-95b0-9117e6e6c65f None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:14.059954 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72bca5-44eb-4c7a-95b0-9117e6e6c65f None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:14.062160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72bca5-44eb-4c7a-95b0-9117e6e6c65f None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:14.064285 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72bca5-44eb-4c7a-95b0-9117e6e6c65f None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:14.066608 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 96/196] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:13 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:14.073201 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72bca5-44eb-4c7a-95b0-9117e6e6c65f None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:14.082439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:14.144887 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff766aa-15a7-4946-92f5-41a349ab2af0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:14.186604 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56112cb-443d-43e6-ad9a-3e1b8957909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:14.187226 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56112cb-443d-43e6-ad9a-3e1b8957909c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:14.187658 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56112cb-443d-43e6-ad9a-3e1b8957909c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:14.187807 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56112cb-443d-43e6-ad9a-3e1b8957909c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:14.212987 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72bca5-44eb-4c7a-95b0-9117e6e6c65f None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:14.245802 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:14.264332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500dd7e-bc92-420f-a192-4737e81ca315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:14.265096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500dd7e-bc92-420f-a192-4737e81ca315 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:14.265448 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500dd7e-bc92-420f-a192-4737e81ca315 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:14.265658 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500dd7e-bc92-420f-a192-4737e81ca315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:14.266488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500dd7e-bc92-420f-a192-4737e81ca315 None admin] RBAC: Adding query filter params (role.id=6d23401ca57e47398bf036ea320a7617, scope.project.id=ee63142a18be4b4e894b8d8097311a63, user.id=bb7d4b7d8809451b8855c45f013fa87c) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:14.266806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500dd7e-bc92-420f-a192-4737e81ca315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:14.269794 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500dd7e-bc92-420f-a192-4737e81ca315 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:14.277391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 97/197] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:14 2022] GET /identity/v3/role_assignments?user.id=bb7d4b7d8809451b8855c45f013fa87c&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=6d23401ca57e47398bf036ea320a7617 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:14.281658 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464ea8c-909f-402f-bcd5-2b78b4227d1a None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:14.281945 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464ea8c-909f-402f-bcd5-2b78b4227d1a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:14.282232 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464ea8c-909f-402f-bcd5-2b78b4227d1a None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:14.283360 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56112cb-443d-43e6-ad9a-3e1b8957909c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:14.284037 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 98/198] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:14 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:14.285067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56112cb-443d-43e6-ad9a-3e1b8957909c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:14.290056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55124bc-4f3d-48b9-a184-e1e526a03432 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:14.290336 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55124bc-4f3d-48b9-a184-e1e526a03432 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:14.290608 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55124bc-4f3d-48b9-a184-e1e526a03432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:14.314098 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-e55124bc-4f3d-48b9-a184-e1e526a03432 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:14.315363 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-e55124bc-4f3d-48b9-a184-e1e526a03432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:14.416189 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:14.424564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 99/199] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:14.436767 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 101/200] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:14 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:14.442964 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55124bc-4f3d-48b9-a184-e1e526a03432 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:14.455395 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56112cb-443d-43e6-ad9a-3e1b8957909c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:14.537000 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:14.560007 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55124bc-4f3d-48b9-a184-e1e526a03432 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:14.570008 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56112cb-443d-43e6-ad9a-3e1b8957909c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:14.597155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204788e0-6e92-4389-982f-498a5d2acb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:14.597803 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204788e0-6e92-4389-982f-498a5d2acb05 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:14.598132 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204788e0-6e92-4389-982f-498a5d2acb05 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:14.598880 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204788e0-6e92-4389-982f-498a5d2acb05 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:14.600152 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204788e0-6e92-4389-982f-498a5d2acb05 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:14.601581 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204788e0-6e92-4389-982f-498a5d2acb05 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:14.603556 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 100/201] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:14 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:14.612377 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204788e0-6e92-4389-982f-498a5d2acb05 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:14.615767 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e46b5-6245-4a78-b32d-3eb7f1344745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:14.616997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e46b5-6245-4a78-b32d-3eb7f1344745 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:14.617502 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e46b5-6245-4a78-b32d-3eb7f1344745 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:14.617966 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e46b5-6245-4a78-b32d-3eb7f1344745 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:14.631235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e46b5-6245-4a78-b32d-3eb7f1344745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-8d8e46b5-6245-4a78-b32d-3eb7f1344745 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:14.641330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:14.642357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:14.643146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:14.646371 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 102/202] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:14.657114 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e46b5-6245-4a78-b32d-3eb7f1344745 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:14.731789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:14.818614 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204788e0-6e92-4389-982f-498a5d2acb05 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:14.872644 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e46b5-6245-4a78-b32d-3eb7f1344745 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:14.884271 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10269de-fa37-4ca1-947a-cfcd4ee18535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:14.884910 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10269de-fa37-4ca1-947a-cfcd4ee18535 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:14.885193 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10269de-fa37-4ca1-947a-cfcd4ee18535 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:14.885471 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10269de-fa37-4ca1-947a-cfcd4ee18535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:14.886271 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10269de-fa37-4ca1-947a-cfcd4ee18535 None admin] RBAC: Adding query filter params (role.id=11db0567e2634cbb9e76b190bddd6e2a, scope.project.id=ee63142a18be4b4e894b8d8097311a63, user.id=bb7d4b7d8809451b8855c45f013fa87c) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:14.886583 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10269de-fa37-4ca1-947a-cfcd4ee18535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:14.888055 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10269de-fa37-4ca1-947a-cfcd4ee18535 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:14.898170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 101/203] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:14 2022] GET /identity/v3/role_assignments?user.id=bb7d4b7d8809451b8855c45f013fa87c&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=11db0567e2634cbb9e76b190bddd6e2a => generated 260 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:14.922757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:14.933527 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83324a93-d0ad-49f6-a0b8-1d611e7e4590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:14.934424 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83324a93-d0ad-49f6-a0b8-1d611e7e4590 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:14.934860 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83324a93-d0ad-49f6-a0b8-1d611e7e4590 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:14.935290 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83324a93-d0ad-49f6-a0b8-1d611e7e4590 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:14.936230 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83324a93-d0ad-49f6-a0b8-1d611e7e4590 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:14.936711 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83324a93-d0ad-49f6-a0b8-1d611e7e4590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:14.938267 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83324a93-d0ad-49f6-a0b8-1d611e7e4590 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:14.947621 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 103/204] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:14 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:14.957270 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10269de-fa37-4ca1-947a-cfcd4ee18535 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:15.107773 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10269de-fa37-4ca1-947a-cfcd4ee18535 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:15.156602 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:15.159917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25c8b7-b7c8-4a41-828e-a04b1152fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:15.160819 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25c8b7-b7c8-4a41-828e-a04b1152fdab None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:15.161259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25c8b7-b7c8-4a41-828e-a04b1152fdab None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:15.161692 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25c8b7-b7c8-4a41-828e-a04b1152fdab None admin] PATH_INFO: `/v3/users/bf4b61afaaca4766aea68825c3a5f69a` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:15.164985 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25c8b7-b7c8-4a41-828e-a04b1152fdab None admin] RBAC: Authorizing `identity:get_user(user_id=bf4b61afaaca4766aea68825c3a5f69a)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:15.166729 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25c8b7-b7c8-4a41-828e-a04b1152fdab None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:15.169244 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 102/205] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:14 2022] GET /identity/v3/users/bf4b61afaaca4766aea68825c3a5f69a => generated 290 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:15.175131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83324a93-d0ad-49f6-a0b8-1d611e7e4590 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:15.327674 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83324a93-d0ad-49f6-a0b8-1d611e7e4590 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:15.371944 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd31780-5706-456b-972d-4eb25f890aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:15.372560 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd31780-5706-456b-972d-4eb25f890aa3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:15.372846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd31780-5706-456b-972d-4eb25f890aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:15.373126 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd31780-5706-456b-972d-4eb25f890aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:15.444142 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:15.452388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd31780-5706-456b-972d-4eb25f890aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:15.454246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd31780-5706-456b-972d-4eb25f890aa3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:15.577778 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 104/206] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:15 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:15.584931 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25c8b7-b7c8-4a41-828e-a04b1152fdab None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:15.712080 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25c8b7-b7c8-4a41-828e-a04b1152fdab None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:15.762892 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfd30a-e00c-4181-a8d2-f6e811ffec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:15.763488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd30a-e00c-4181-a8d2-f6e811ffec46 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:15.763804 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd30a-e00c-4181-a8d2-f6e811ffec46 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:15.764060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfd30a-e00c-4181-a8d2-f6e811ffec46 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:15.765602 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfd30a-e00c-4181-a8d2-f6e811ffec46 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:15.767238 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfd30a-e00c-4181-a8d2-f6e811ffec46 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:15.770930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 103/207] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:15 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:15.777274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd31780-5706-456b-972d-4eb25f890aa3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:15.886789 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:15.900405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd31780-5706-456b-972d-4eb25f890aa3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:15.944599 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e938d8-cf35-458b-b7bf-331e3c1d7436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:15.945225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e938d8-cf35-458b-b7bf-331e3c1d7436 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:15.945513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e938d8-cf35-458b-b7bf-331e3c1d7436 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:15.945790 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e938d8-cf35-458b-b7bf-331e3c1d7436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:15.946647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e938d8-cf35-458b-b7bf-331e3c1d7436 None admin] RBAC: Adding query filter params (role.id=4ff172ce2b424a9589c1730145dd135e, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9, user.id=bf4b61afaaca4766aea68825c3a5f69a) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:15.946962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e938d8-cf35-458b-b7bf-331e3c1d7436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:15.948435 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e938d8-cf35-458b-b7bf-331e3c1d7436 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:15.954767 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 105/208] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:15 2022] GET /identity/v3/role_assignments?user.id=bf4b61afaaca4766aea68825c3a5f69a&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=4ff172ce2b424a9589c1730145dd135e => generated 610 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:16.870481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377e86-0344-4cab-a5ff-0f2c13316638 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:16.870993 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377e86-0344-4cab-a5ff-0f2c13316638 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:16.870993 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377e86-0344-4cab-a5ff-0f2c13316638 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:16.872625 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 104/209] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:16.878427 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e16d-fc5e-4858-8269-27d7db0d1944 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:16.878889 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e16d-fc5e-4858-8269-27d7db0d1944 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:16.878972 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7e16d-fc5e-4858-8269-27d7db0d1944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:16.899141 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-daf7e16d-fc5e-4858-8269-27d7db0d1944 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:16.900402 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-daf7e16d-fc5e-4858-8269-27d7db0d1944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:16.964997 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a38b2-3180-4374-8a85-f38d5a57b494 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:16.965642 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a38b2-3180-4374-8a85-f38d5a57b494 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:16.966020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a38b2-3180-4374-8a85-f38d5a57b494 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:16.967562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 105/210] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:16.973517 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459d72-cbc0-406b-8117-c983ea6eb1a5 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:16.974029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459d72-cbc0-406b-8117-c983ea6eb1a5 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:16.974483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01459d72-cbc0-406b-8117-c983ea6eb1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:16.977388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 106/211] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:16.996808 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-01459d72-cbc0-406b-8117-c983ea6eb1a5 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:16.998019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-01459d72-cbc0-406b-8117-c983ea6eb1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:17.002830 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e16d-fc5e-4858-8269-27d7db0d1944 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:17.077677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:17.085050 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 106/212] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:17.092348 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109970e-5cce-47a8-be26-c73d5c1b8ff2 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.092348 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109970e-5cce-47a8-be26-c73d5c1b8ff2 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.092348 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109970e-5cce-47a8-be26-c73d5c1b8ff2 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.092590 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 107/213] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:17.098469 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67db76-1c4d-4ec6-8925-d27b0b1e344e None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.100498 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67db76-1c4d-4ec6-8925-d27b0b1e344e None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.100498 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67db76-1c4d-4ec6-8925-d27b0b1e344e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.118539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:17.123374 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-9c67db76-1c4d-4ec6-8925-d27b0b1e344e None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:17.126508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-9c67db76-1c4d-4ec6-8925-d27b0b1e344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:17.136839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7e16d-fc5e-4858-8269-27d7db0d1944 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:17.175907 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a887e-9cb2-4217-9461-a5e42656d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:17.177501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a887e-9cb2-4217-9461-a5e42656d331 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.177777 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a887e-9cb2-4217-9461-a5e42656d331 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.178044 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a887e-9cb2-4217-9461-a5e42656d331 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.188794 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a887e-9cb2-4217-9461-a5e42656d331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-5d0a887e-9cb2-4217-9461-a5e42656d331 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:17.194263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:17.195238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:17.196302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 107/214] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:17.201000 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a887e-9cb2-4217-9461-a5e42656d331 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:17.222969 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 108/215] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:17.225043 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67db76-1c4d-4ec6-8925-d27b0b1e344e None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:17.322054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a887e-9cb2-4217-9461-a5e42656d331 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:17.346722 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67db76-1c4d-4ec6-8925-d27b0b1e344e None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:17.360720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3565a46-f236-47e4-93b7-47597592ee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:17.361377 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3565a46-f236-47e4-93b7-47597592ee79 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.361668 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3565a46-f236-47e4-93b7-47597592ee79 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.361937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3565a46-f236-47e4-93b7-47597592ee79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.363236 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3565a46-f236-47e4-93b7-47597592ee79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:17.365586 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3565a46-f236-47e4-93b7-47597592ee79 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:17.369521 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 108/216] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:17.372684 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3565a46-f236-47e4-93b7-47597592ee79 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:17.380649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:17.389661 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad17fe-c405-4981-b60a-9e7b854b21e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:17.390802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad17fe-c405-4981-b60a-9e7b854b21e2 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.391095 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad17fe-c405-4981-b60a-9e7b854b21e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.391372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad17fe-c405-4981-b60a-9e7b854b21e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.392246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad17fe-c405-4981-b60a-9e7b854b21e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:17.392642 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad17fe-c405-4981-b60a-9e7b854b21e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:17.394205 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad17fe-c405-4981-b60a-9e7b854b21e2 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:17.394740 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:17.404505 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 109/217] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:17 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:17.410303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad17fe-c405-4981-b60a-9e7b854b21e2 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:17.491663 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3565a46-f236-47e4-93b7-47597592ee79 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:17.529332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ac719-7ec3-4fb2-9fb5-3d4cd64ea22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:17.530027 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ac719-7ec3-4fb2-9fb5-3d4cd64ea22c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.530307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ac719-7ec3-4fb2-9fb5-3d4cd64ea22c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.530607 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ac719-7ec3-4fb2-9fb5-3d4cd64ea22c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.533062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad17fe-c405-4981-b60a-9e7b854b21e2 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:17.554708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ac719-7ec3-4fb2-9fb5-3d4cd64ea22c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-9b7ac719-7ec3-4fb2-9fb5-3d4cd64ea22c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:17.560368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:17.562183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 109/218] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:17.564018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ac719-7ec3-4fb2-9fb5-3d4cd64ea22c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:17.591606 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21719c9-3c9d-4deb-9214-df0ff55b508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:17.592276 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21719c9-3c9d-4deb-9214-df0ff55b508f None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.592559 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21719c9-3c9d-4deb-9214-df0ff55b508f None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.592836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21719c9-3c9d-4deb-9214-df0ff55b508f None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.593519 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21719c9-3c9d-4deb-9214-df0ff55b508f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:17.595998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21719c9-3c9d-4deb-9214-df0ff55b508f None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:17.658547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:17.684890 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ac719-7ec3-4fb2-9fb5-3d4cd64ea22c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:17.720468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8379ba-b7ec-42a5-83d7-bdf80ae27efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:17.721878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8379ba-b7ec-42a5-83d7-bdf80ae27efd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.722186 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8379ba-b7ec-42a5-83d7-bdf80ae27efd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.722464 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8379ba-b7ec-42a5-83d7-bdf80ae27efd None admin] PATH_INFO: `/v3/users/179ad6a395e44affa6e19e8777db3dff` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.728927 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 110/219] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:11:17 2022] POST /identity/v3/users => generated 298 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:17.737695 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21719c9-3c9d-4deb-9214-df0ff55b508f None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:17.740552 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8379ba-b7ec-42a5-83d7-bdf80ae27efd None admin] RBAC: Authorizing `identity:get_user(user_id=179ad6a395e44affa6e19e8777db3dff)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:17.742374 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8379ba-b7ec-42a5-83d7-bdf80ae27efd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:17.750056 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 110/220] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:17 2022] GET /identity/v3/users/179ad6a395e44affa6e19e8777db3dff => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:17.757788 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8379ba-b7ec-42a5-83d7-bdf80ae27efd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:17.808840 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:17.874532 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21719c9-3c9d-4deb-9214-df0ff55b508f None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:17.889830 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8379ba-b7ec-42a5-83d7-bdf80ae27efd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:17.918027 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eb090-8738-43fa-a6a0-067e142e2e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:17.918989 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb090-8738-43fa-a6a0-067e142e2e8f None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.918989 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb090-8738-43fa-a6a0-067e142e2e8f None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.919209 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb090-8738-43fa-a6a0-067e142e2e8f None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.919841 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eb090-8738-43fa-a6a0-067e142e2e8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:17.920192 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eb090-8738-43fa-a6a0-067e142e2e8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:17.926823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eb090-8738-43fa-a6a0-067e142e2e8f None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:17.933033 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b695e-7897-4202-804d-4d527747dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:17.933655 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b695e-7897-4202-804d-4d527747dd6c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.933934 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b695e-7897-4202-804d-4d527747dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.934201 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b695e-7897-4202-804d-4d527747dd6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.937164 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 111/221] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:17 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:17.938180 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7114bd0-954f-4ed0-9e2e-4509958fa1c7 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:17.938479 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7114bd0-954f-4ed0-9e2e-4509958fa1c7 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:17.938755 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7114bd0-954f-4ed0-9e2e-4509958fa1c7 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:17.940030 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 112/222] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:17.944010 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7114bd0-954f-4ed0-9e2e-4509958fa1c7 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:17.945166 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:18.022507 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b695e-7897-4202-804d-4d527747dd6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:18.023979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b695e-7897-4202-804d-4d527747dd6c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:18.089833 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7114bd0-954f-4ed0-9e2e-4509958fa1c7 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:18.099993 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:18.133319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993ce67-d29d-4a9d-bb30-e3f6a29bd11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:18.133968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993ce67-d29d-4a9d-bb30-e3f6a29bd11b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:18.134248 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993ce67-d29d-4a9d-bb30-e3f6a29bd11b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:18.134521 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993ce67-d29d-4a9d-bb30-e3f6a29bd11b None admin] PATH_INFO: `/v3/users/bb7d4b7d8809451b8855c45f013fa87c` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:18.135768 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993ce67-d29d-4a9d-bb30-e3f6a29bd11b None admin] RBAC: Authorizing `identity:get_user(user_id=bb7d4b7d8809451b8855c45f013fa87c)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:18.137184 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993ce67-d29d-4a9d-bb30-e3f6a29bd11b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:18.138842 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 113/223] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:17 2022] GET /identity/v3/users/bb7d4b7d8809451b8855c45f013fa87c => generated 284 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:18.139997 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086e3ca-cad4-4502-bcbd-99da1992f4bf None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:18.140311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086e3ca-cad4-4502-bcbd-99da1992f4bf None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:18.140823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086e3ca-cad4-4502-bcbd-99da1992f4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:18.150726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 111/224] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:18.156101 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b695e-7897-4202-804d-4d527747dd6c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:18.159900 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-9086e3ca-cad4-4502-bcbd-99da1992f4bf None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:18.162494 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-9086e3ca-cad4-4502-bcbd-99da1992f4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:18.199193 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:18.244756 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 114/225] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:18.245682 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086e3ca-cad4-4502-bcbd-99da1992f4bf None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:18.288210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b695e-7897-4202-804d-4d527747dd6c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:18.327563 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228edc-05a0-4c27-9c87-241613ee4d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:18.328575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228edc-05a0-4c27-9c87-241613ee4d70 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:18.329012 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228edc-05a0-4c27-9c87-241613ee4d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:18.329464 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228edc-05a0-4c27-9c87-241613ee4d70 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:18.330945 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5228edc-05a0-4c27-9c87-241613ee4d70 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:18.333296 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5228edc-05a0-4c27-9c87-241613ee4d70 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:18.335244 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 112/226] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:18 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:18.336300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228edc-05a0-4c27-9c87-241613ee4d70 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:18.355252 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086e3ca-cad4-4502-bcbd-99da1992f4bf None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:18.360294 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:18.396447 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0651c34-c560-441f-b543-b9e07c1c1485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:18.397929 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0651c34-c560-441f-b543-b9e07c1c1485 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:18.399670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0651c34-c560-441f-b543-b9e07c1c1485 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:18.400319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0651c34-c560-441f-b543-b9e07c1c1485 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:18.401773 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0651c34-c560-441f-b543-b9e07c1c1485 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:18.403316 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0651c34-c560-441f-b543-b9e07c1c1485 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:18.405625 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 115/227] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:18 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:18.406664 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0651c34-c560-441f-b543-b9e07c1c1485 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:18.465548 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228edc-05a0-4c27-9c87-241613ee4d70 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:18.467495 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:18.505535 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd84da-aff6-44d7-b81c-855e70274c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:18.506574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd84da-aff6-44d7-b81c-855e70274c69 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:18.507006 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd84da-aff6-44d7-b81c-855e70274c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:18.507442 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd84da-aff6-44d7-b81c-855e70274c69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:18.519182 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd84da-aff6-44d7-b81c-855e70274c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-71dd84da-aff6-44d7-b81c-855e70274c69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:18.524612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:18.525725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:18.526603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:18.528877 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 113/228] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:18.529959 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd84da-aff6-44d7-b81c-855e70274c69 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:18.552732 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0651c34-c560-441f-b543-b9e07c1c1485 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:18.592271 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4b190-48f2-40aa-91e1-039cabc09fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:18.593014 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4b190-48f2-40aa-91e1-039cabc09fb9 None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:18.593344 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4b190-48f2-40aa-91e1-039cabc09fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:18.593620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4b190-48f2-40aa-91e1-039cabc09fb9 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63/users/bb7d4b7d8809451b8855c45f013fa87c/roles/6d23401ca57e47398bf036ea320a7617` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:18.596427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4b190-48f2-40aa-91e1-039cabc09fb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee63142a18be4b4e894b8d8097311a63, user_id=bb7d4b7d8809451b8855c45f013fa87c, role_id=6d23401ca57e47398bf036ea320a7617)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:18.597774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4b190-48f2-40aa-91e1-039cabc09fb9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:18.639823 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd84da-aff6-44d7-b81c-855e70274c69 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:18.675346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5da7-8d5d-4e7b-8d4b-bce1b019c0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:18.675967 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5da7-8d5d-4e7b-8d4b-bce1b019c0c0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:18.676843 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5da7-8d5d-4e7b-8d4b-bce1b019c0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:18.677128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5da7-8d5d-4e7b-8d4b-bce1b019c0c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:18.677928 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e5da7-8d5d-4e7b-8d4b-bce1b019c0c0 None admin] RBAC: Adding query filter params (role.id=7b33619ed33f41c0b797124afa4a385d, scope.project.id=ee63142a18be4b4e894b8d8097311a63, user.id=179ad6a395e44affa6e19e8777db3dff) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:18.678238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e5da7-8d5d-4e7b-8d4b-bce1b019c0c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:18.679675 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e5da7-8d5d-4e7b-8d4b-bce1b019c0c0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:18.686152 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 114/229] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:18 2022] GET /identity/v3/role_assignments?user.id=179ad6a395e44affa6e19e8777db3dff&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=7b33619ed33f41c0b797124afa4a385d => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:18.686981 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5da7-8d5d-4e7b-8d4b-bce1b019c0c0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:18.693364 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 116/230] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:11:18 2022] PUT /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63/users/bb7d4b7d8809451b8855c45f013fa87c/roles/6d23401ca57e47398bf036ea320a7617 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:18.727351 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:18.844510 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5da7-8d5d-4e7b-8d4b-bce1b019c0c0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:18.900729 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162e4fb-db96-4755-b810-a05a6ec95b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:18.901394 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e4fb-db96-4755-b810-a05a6ec95b80 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:18.901647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e4fb-db96-4755-b810-a05a6ec95b80 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:18.901901 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162e4fb-db96-4755-b810-a05a6ec95b80 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:18.902634 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162e4fb-db96-4755-b810-a05a6ec95b80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:18.902935 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162e4fb-db96-4755-b810-a05a6ec95b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:18.904548 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162e4fb-db96-4755-b810-a05a6ec95b80 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:18.919665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 115/231] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:18 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:18.925895 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4b190-48f2-40aa-91e1-039cabc09fb9 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:18.965021 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:19.046460 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4b190-48f2-40aa-91e1-039cabc09fb9 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:19.090874 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b850558-9400-49ba-8286-c8feb6a0b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:19.091519 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b850558-9400-49ba-8286-c8feb6a0b3c9 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:19.091801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b850558-9400-49ba-8286-c8feb6a0b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:19.092073 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b850558-9400-49ba-8286-c8feb6a0b3c9 None admin] PATH_INFO: `/v3/users/bb7d4b7d8809451b8855c45f013fa87c` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:19.093264 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b850558-9400-49ba-8286-c8feb6a0b3c9 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7d4b7d8809451b8855c45f013fa87c)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:19.094845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b850558-9400-49ba-8286-c8feb6a0b3c9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:19.096769 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 117/232] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:18 2022] GET /identity/v3/users/bb7d4b7d8809451b8855c45f013fa87c => generated 284 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:19.103002 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162e4fb-db96-4755-b810-a05a6ec95b80 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:19.240727 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:19.255421 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162e4fb-db96-4755-b810-a05a6ec95b80 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:19.296096 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f31493-9427-48fe-8128-c58982f41258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:19.296837 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f31493-9427-48fe-8128-c58982f41258 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:19.297066 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f31493-9427-48fe-8128-c58982f41258 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:19.297393 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f31493-9427-48fe-8128-c58982f41258 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:19.298630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f31493-9427-48fe-8128-c58982f41258 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:19.300101 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f31493-9427-48fe-8128-c58982f41258 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:19.302326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 116/233] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:19 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:19.308057 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b850558-9400-49ba-8286-c8feb6a0b3c9 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:19.465941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:19.469899 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b850558-9400-49ba-8286-c8feb6a0b3c9 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:19.512548 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ae006-0e89-4cc0-b197-e81e1a8caeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:19.513226 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae006-0e89-4cc0-b197-e81e1a8caeb7 None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:19.513508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae006-0e89-4cc0-b197-e81e1a8caeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:19.513786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ae006-0e89-4cc0-b197-e81e1a8caeb7 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63/users/bb7d4b7d8809451b8855c45f013fa87c/roles/11db0567e2634cbb9e76b190bddd6e2a` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:19.522353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ae006-0e89-4cc0-b197-e81e1a8caeb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee63142a18be4b4e894b8d8097311a63, user_id=bb7d4b7d8809451b8855c45f013fa87c, role_id=11db0567e2634cbb9e76b190bddd6e2a)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:19.523841 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ae006-0e89-4cc0-b197-e81e1a8caeb7 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:19.694762 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 118/234] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:11:19 2022] PUT /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63/users/bb7d4b7d8809451b8855c45f013fa87c/roles/11db0567e2634cbb9e76b190bddd6e2a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:20.683094 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e13b8-8e92-4022-a17a-7efffa872aa4 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:20.683602 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e13b8-8e92-4022-a17a-7efffa872aa4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:20.683676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e13b8-8e92-4022-a17a-7efffa872aa4 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:20.685015 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 117/235] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:20.687539 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c3500-9972-4eee-aac4-a344e6c3656a None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:20.688075 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c3500-9972-4eee-aac4-a344e6c3656a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:20.688075 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c3500-9972-4eee-aac4-a344e6c3656a None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:20.689447 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 119/236] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:20.693828 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfdc39-47f3-4520-a28a-fb2933192b01 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:20.694115 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfdc39-47f3-4520-a28a-fb2933192b01 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:20.694393 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfdc39-47f3-4520-a28a-fb2933192b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:20.701886 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee00d77-719e-4149-a42f-164a89732c5a None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:20.702168 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee00d77-719e-4149-a42f-164a89732c5a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:20.702443 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee00d77-719e-4149-a42f-164a89732c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:20.720834 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-d1bfdc39-47f3-4520-a28a-fb2933192b01 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:20.724501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-d1bfdc39-47f3-4520-a28a-fb2933192b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:20.741025 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-aee00d77-719e-4149-a42f-164a89732c5a None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:20.742132 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-aee00d77-719e-4149-a42f-164a89732c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:20.857233 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 118/237] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:20.874644 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 120/238] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:20.892944 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfdc39-47f3-4520-a28a-fb2933192b01 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:20.913691 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee00d77-719e-4149-a42f-164a89732c5a None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:21.049783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:21.065304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfdc39-47f3-4520-a28a-fb2933192b01 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:21.093189 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:21.107674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee00d77-719e-4149-a42f-164a89732c5a None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:21.110112 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6808da-20c5-4db7-b089-2cf37483b13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:21.110873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6808da-20c5-4db7-b089-2cf37483b13f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.111155 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6808da-20c5-4db7-b089-2cf37483b13f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.111430 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6808da-20c5-4db7-b089-2cf37483b13f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.114155 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6808da-20c5-4db7-b089-2cf37483b13f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:21.115641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6808da-20c5-4db7-b089-2cf37483b13f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:21.117272 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 119/239] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:20 2022] GET /identity/v3/domains/default => generated 200 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:21.127330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6808da-20c5-4db7-b089-2cf37483b13f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:21.175474 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221f6ae-2068-499c-9c7f-aeebc53aded7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:21.176699 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221f6ae-2068-499c-9c7f-aeebc53aded7 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.176988 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221f6ae-2068-499c-9c7f-aeebc53aded7 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.177268 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221f6ae-2068-499c-9c7f-aeebc53aded7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.190397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221f6ae-2068-499c-9c7f-aeebc53aded7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-5221f6ae-2068-499c-9c7f-aeebc53aded7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:21.196562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:21.197959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:21.198739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 121/240] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:21.204135 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ceddf-acf5-41b6-aba5-a1efd1480c0c None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.204135 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ceddf-acf5-41b6-aba5-a1efd1480c0c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.204135 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ceddf-acf5-41b6-aba5-a1efd1480c0c None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.204135 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 122/241] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:21.205902 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ceddf-acf5-41b6-aba5-a1efd1480c0c None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:21.270513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6808da-20c5-4db7-b089-2cf37483b13f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:21.311605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8561e1-4998-4cc4-aff7-6d5847a0d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:21.312167 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8561e1-4998-4cc4-aff7-6d5847a0d943 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.312459 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8561e1-4998-4cc4-aff7-6d5847a0d943 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.312731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8561e1-4998-4cc4-aff7-6d5847a0d943 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.313425 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8561e1-4998-4cc4-aff7-6d5847a0d943 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:21.314878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8561e1-4998-4cc4-aff7-6d5847a0d943 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:21.328350 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ceddf-acf5-41b6-aba5-a1efd1480c0c None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:21.370620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1dc95-9806-4b6c-bc4e-9e32ba85daec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:21.371252 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1dc95-9806-4b6c-bc4e-9e32ba85daec None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.371533 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1dc95-9806-4b6c-bc4e-9e32ba85daec None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.371806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1dc95-9806-4b6c-bc4e-9e32ba85daec None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.372562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1dc95-9806-4b6c-bc4e-9e32ba85daec None admin] RBAC: Adding query filter params (name=reader) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:21.372865 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1dc95-9806-4b6c-bc4e-9e32ba85daec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:21.374272 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1dc95-9806-4b6c-bc4e-9e32ba85daec None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:21.383284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 123/242] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:21 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:21.384514 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93591a7-757c-4be7-84fd-1f890849c3fb None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.388195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93591a7-757c-4be7-84fd-1f890849c3fb None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.388195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93591a7-757c-4be7-84fd-1f890849c3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.404537 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-a93591a7-757c-4be7-84fd-1f890849c3fb None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:21.405726 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-a93591a7-757c-4be7-84fd-1f890849c3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:21.414171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:21.462916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 120/243] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:11:21 2022] POST /identity/v3/users => generated 294 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:21.463757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8561e1-4998-4cc4-aff7-6d5847a0d943 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:21.496422 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:21.523750 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 124/244] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:21.525659 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8fbdf-50b2-47fa-9295-d0cf4ae2c559 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.528248 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8fbdf-50b2-47fa-9295-d0cf4ae2c559 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.528970 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8fbdf-50b2-47fa-9295-d0cf4ae2c559 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.532186 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 125/245] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:21 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:21.543422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914cd2d-2197-409c-8ab6-11e300877c7a None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.544244 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914cd2d-2197-409c-8ab6-11e300877c7a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.547155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914cd2d-2197-409c-8ab6-11e300877c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.645606 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8561e1-4998-4cc4-aff7-6d5847a0d943 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:21.686348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6768f-8008-43a3-9102-d6f52fbaec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:21.686997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6768f-8008-43a3-9102-d6f52fbaec2f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.687281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6768f-8008-43a3-9102-d6f52fbaec2f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.687694 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6768f-8008-43a3-9102-d6f52fbaec2f None admin] PATH_INFO: `/v3/users/ac3f45a507654cd6a8a48cc4fbf65059` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.699630 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-a914cd2d-2197-409c-8ab6-11e300877c7a None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:21.700943 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-a914cd2d-2197-409c-8ab6-11e300877c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:21.702701 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6768f-8008-43a3-9102-d6f52fbaec2f None admin] RBAC: Authorizing `identity:get_user(user_id=ac3f45a507654cd6a8a48cc4fbf65059)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:21.704366 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6768f-8008-43a3-9102-d6f52fbaec2f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:21.706408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 121/246] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:21 2022] GET /identity/v3/users/ac3f45a507654cd6a8a48cc4fbf65059 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:21.707725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6768f-8008-43a3-9102-d6f52fbaec2f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:21.779050 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:21.794233 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 126/247] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:21.801166 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914cd2d-2197-409c-8ab6-11e300877c7a None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:21.827849 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6768f-8008-43a3-9102-d6f52fbaec2f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:21.884948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d7ddd-66d6-4906-ac52-082ea4ea69cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:21.885598 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d7ddd-66d6-4906-ac52-082ea4ea69cf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.886601 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d7ddd-66d6-4906-ac52-082ea4ea69cf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.886601 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d7ddd-66d6-4906-ac52-082ea4ea69cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:21.887340 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:21.901709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d7ddd-66d6-4906-ac52-082ea4ea69cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f94d7ddd-66d6-4906-ac52-082ea4ea69cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:21.907452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:21.908436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:21.909326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 122/248] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:21.910592 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d7ddd-66d6-4906-ac52-082ea4ea69cf None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:21.927987 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914cd2d-2197-409c-8ab6-11e300877c7a None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:21.976639 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcc725-2ddb-43d8-89db-8bdf6e412467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:21.977273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcc725-2ddb-43d8-89db-8bdf6e412467 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:21.977557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcc725-2ddb-43d8-89db-8bdf6e412467 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:21.977837 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcc725-2ddb-43d8-89db-8bdf6e412467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.033069 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d7ddd-66d6-4906-ac52-082ea4ea69cf None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.067372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcc725-2ddb-43d8-89db-8bdf6e412467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.068931 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcc725-2ddb-43d8-89db-8bdf6e412467 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.070037 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.079652 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba20d-aa00-4ae2-a8c4-ec6515739809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.080348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba20d-aa00-4ae2-a8c4-ec6515739809 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.080633 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba20d-aa00-4ae2-a8c4-ec6515739809 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.080913 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba20d-aa00-4ae2-a8c4-ec6515739809 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.093087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ba20d-aa00-4ae2-a8c4-ec6515739809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-e81ba20d-aa00-4ae2-a8c4-ec6515739809 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:22.098284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:22.099361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:22.100291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 123/249] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:11:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:22.100955 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba20d-aa00-4ae2-a8c4-ec6515739809 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:22.166492 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.207616 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 127/250] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:22.208914 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcc725-2ddb-43d8-89db-8bdf6e412467 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:22.214216 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba20d-aa00-4ae2-a8c4-ec6515739809 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.253087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf8495-c14e-441a-92d3-0c0e5d7b1051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.253710 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf8495-c14e-441a-92d3-0c0e5d7b1051 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.254110 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf8495-c14e-441a-92d3-0c0e5d7b1051 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.255368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf8495-c14e-441a-92d3-0c0e5d7b1051 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.256109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf8495-c14e-441a-92d3-0c0e5d7b1051 None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:22.256464 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf8495-c14e-441a-92d3-0c0e5d7b1051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.258635 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf8495-c14e-441a-92d3-0c0e5d7b1051 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.270104 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 124/251] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:22 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:22.271284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf8495-c14e-441a-92d3-0c0e5d7b1051 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:22.319336 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcc725-2ddb-43d8-89db-8bdf6e412467 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.336694 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.358959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712387f6-3fa5-49f9-b98b-aa81436bbd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.360002 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712387f6-3fa5-49f9-b98b-aa81436bbd21 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.360548 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712387f6-3fa5-49f9-b98b-aa81436bbd21 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.361028 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712387f6-3fa5-49f9-b98b-aa81436bbd21 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.361975 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712387f6-3fa5-49f9-b98b-aa81436bbd21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:22.362523 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712387f6-3fa5-49f9-b98b-aa81436bbd21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.364758 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712387f6-3fa5-49f9-b98b-aa81436bbd21 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.374658 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 128/252] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:22.375918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712387f6-3fa5-49f9-b98b-aa81436bbd21 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:22.387295 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf8495-c14e-441a-92d3-0c0e5d7b1051 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.423467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505819c9-4ebe-44b9-8bfe-a610558d3bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.424072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505819c9-4ebe-44b9-8bfe-a610558d3bed None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.424389 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505819c9-4ebe-44b9-8bfe-a610558d3bed None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.424668 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505819c9-4ebe-44b9-8bfe-a610558d3bed None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.432140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505819c9-4ebe-44b9-8bfe-a610558d3bed None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.432140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505819c9-4ebe-44b9-8bfe-a610558d3bed None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.432140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 125/253] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:22 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:22.432140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505819c9-4ebe-44b9-8bfe-a610558d3bed None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:22.435918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.547021 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712387f6-3fa5-49f9-b98b-aa81436bbd21 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.560450 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505819c9-4ebe-44b9-8bfe-a610558d3bed None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.579623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.587681 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb66e79-95e2-47d8-a389-0858485796ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.595085 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb66e79-95e2-47d8-a389-0858485796ce None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.595085 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb66e79-95e2-47d8-a389-0858485796ce None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.595085 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb66e79-95e2-47d8-a389-0858485796ce None admin] PATH_INFO: `/v3/users/179ad6a395e44affa6e19e8777db3dff` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.595085 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb66e79-95e2-47d8-a389-0858485796ce None admin] RBAC: Authorizing `identity:get_user(user_id=179ad6a395e44affa6e19e8777db3dff)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.595085 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb66e79-95e2-47d8-a389-0858485796ce None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.595085 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 129/254] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:22 2022] GET /identity/v3/users/179ad6a395e44affa6e19e8777db3dff => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:22.595652 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb66e79-95e2-47d8-a389-0858485796ce None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:22.603622 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd117475-aee3-4a63-bebc-905f8d1f5c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.604312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117475-aee3-4a63-bebc-905f8d1f5c29 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.604762 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117475-aee3-4a63-bebc-905f8d1f5c29 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.605186 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd117475-aee3-4a63-bebc-905f8d1f5c29 None admin] PATH_INFO: `/v3/users/bb7d4b7d8809451b8855c45f013fa87c` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.606647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd117475-aee3-4a63-bebc-905f8d1f5c29 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7d4b7d8809451b8855c45f013fa87c)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.608340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd117475-aee3-4a63-bebc-905f8d1f5c29 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.610121 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 126/255] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:22 2022] GET /identity/v3/users/bb7d4b7d8809451b8855c45f013fa87c => generated 284 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:22.611459 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01cd9-8bb0-4c92-9ee5-9c421f7fd821 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.611890 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01cd9-8bb0-4c92-9ee5-9c421f7fd821 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.613253 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c01cd9-8bb0-4c92-9ee5-9c421f7fd821 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.615208 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 127/256] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:22.616280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c01cd9-8bb0-4c92-9ee5-9c421f7fd821 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:22.709064 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb66e79-95e2-47d8-a389-0858485796ce None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.711187 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.728201 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c01cd9-8bb0-4c92-9ee5-9c421f7fd821 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.745496 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381381be-e1af-49c7-ad2b-7694e942da13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.746121 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381381be-e1af-49c7-ad2b-7694e942da13 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.746569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381381be-e1af-49c7-ad2b-7694e942da13 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.747010 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381381be-e1af-49c7-ad2b-7694e942da13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.747941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381381be-e1af-49c7-ad2b-7694e942da13 None admin] RBAC: Adding query filter params (role.id=4ff172ce2b424a9589c1730145dd135e, scope.project.id=ee63142a18be4b4e894b8d8097311a63, user.id=ac3f45a507654cd6a8a48cc4fbf65059) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:22.748592 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381381be-e1af-49c7-ad2b-7694e942da13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.751138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381381be-e1af-49c7-ad2b-7694e942da13 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.759107 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 130/257] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:22 2022] GET /identity/v3/role_assignments?user.id=ac3f45a507654cd6a8a48cc4fbf65059&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=4ff172ce2b424a9589c1730145dd135e => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:22.760623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381381be-e1af-49c7-ad2b-7694e942da13 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:22.776568 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eebcc4-80b4-4255-a6af-d51a6529b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.777263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebcc4-80b4-4255-a6af-d51a6529b548 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.777563 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebcc4-80b4-4255-a6af-d51a6529b548 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.777842 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eebcc4-80b4-4255-a6af-d51a6529b548 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.783011 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eebcc4-80b4-4255-a6af-d51a6529b548 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:22.784606 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eebcc4-80b4-4255-a6af-d51a6529b548 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:22.786611 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 128/258] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:22 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:22.787968 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a745b6d-fb12-4202-bcec-7f796cbb5438 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.788135 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a745b6d-fb12-4202-bcec-7f796cbb5438 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.788432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a745b6d-fb12-4202-bcec-7f796cbb5438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.822938 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-9a745b6d-fb12-4202-bcec-7f796cbb5438 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:22.824270 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9a745b6d-fb12-4202-bcec-7f796cbb5438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:22.925376 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381381be-e1af-49c7-ad2b-7694e942da13 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:22.930293 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:22.966902 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6939c7-af2d-4dd7-ac45-16c9519e378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:22.967928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6939c7-af2d-4dd7-ac45-16c9519e378e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:22.968484 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6939c7-af2d-4dd7-ac45-16c9519e378e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:22.968991 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6939c7-af2d-4dd7-ac45-16c9519e378e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:22.978540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 129/259] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:22.984373 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a745b6d-fb12-4202-bcec-7f796cbb5438 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.029007 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:23.071441 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6939c7-af2d-4dd7-ac45-16c9519e378e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.072981 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6939c7-af2d-4dd7-ac45-16c9519e378e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.113294 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a745b6d-fb12-4202-bcec-7f796cbb5438 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.155010 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c927c-603c-4852-aedd-437fa31f9a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.156032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c927c-603c-4852-aedd-437fa31f9a39 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.157785 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c927c-603c-4852-aedd-437fa31f9a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.158274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c927c-603c-4852-aedd-437fa31f9a39 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63/users/179ad6a395e44affa6e19e8777db3dff/roles/7b33619ed33f41c0b797124afa4a385d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.164556 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c927c-603c-4852-aedd-437fa31f9a39 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee63142a18be4b4e894b8d8097311a63, user_id=179ad6a395e44affa6e19e8777db3dff, role_id=7b33619ed33f41c0b797124afa4a385d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.166294 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c927c-603c-4852-aedd-437fa31f9a39 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.247837 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 131/260] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:23.249058 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6939c7-af2d-4dd7-ac45-16c9519e378e None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.270602 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 130/261] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:11:22 2022] PUT /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63/users/179ad6a395e44affa6e19e8777db3dff/roles/7b33619ed33f41c0b797124afa4a385d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:23.271918 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c927c-603c-4852-aedd-437fa31f9a39 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.382930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:23.402030 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:23.477161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c927c-603c-4852-aedd-437fa31f9a39 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.511927 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6939c7-af2d-4dd7-ac45-16c9519e378e None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.554423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be9641-79a3-496b-9204-989ed2b020f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.559041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9641-79a3-496b-9204-989ed2b020f1 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.559041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9641-79a3-496b-9204-989ed2b020f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.559041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be9641-79a3-496b-9204-989ed2b020f1 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.559041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be9641-79a3-496b-9204-989ed2b020f1 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.559359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be9641-79a3-496b-9204-989ed2b020f1 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.561428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 131/262] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:23 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:23.568066 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be9641-79a3-496b-9204-989ed2b020f1 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.591818 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27998c-7a12-4550-b2d4-d903cd3b7c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.592819 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27998c-7a12-4550-b2d4-d903cd3b7c96 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.593285 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27998c-7a12-4550-b2d4-d903cd3b7c96 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.593848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27998c-7a12-4550-b2d4-d903cd3b7c96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.620716 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27998c-7a12-4550-b2d4-d903cd3b7c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-cb27998c-7a12-4550-b2d4-d903cd3b7c96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:23.632160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:23.637477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:23.638319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 132/263] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:23.640957 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27998c-7a12-4550-b2d4-d903cd3b7c96 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:23.793996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be9641-79a3-496b-9204-989ed2b020f1 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.823112 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:23.852194 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27998c-7a12-4550-b2d4-d903cd3b7c96 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:23.861438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee459979-2a83-4459-9374-08c0331a7c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.862066 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459979-2a83-4459-9374-08c0331a7c42 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.862470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459979-2a83-4459-9374-08c0331a7c42 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.862753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459979-2a83-4459-9374-08c0331a7c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.864095 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee459979-2a83-4459-9374-08c0331a7c42 None admin] RBAC: Adding query filter params (role.id=6d23401ca57e47398bf036ea320a7617, scope.project.id=ee63142a18be4b4e894b8d8097311a63, user.id=bb7d4b7d8809451b8855c45f013fa87c) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:23.864432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee459979-2a83-4459-9374-08c0331a7c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.866015 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee459979-2a83-4459-9374-08c0331a7c42 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.877156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 132/264] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:23 2022] GET /identity/v3/role_assignments?user.id=bb7d4b7d8809451b8855c45f013fa87c&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=6d23401ca57e47398bf036ea320a7617 => generated 610 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:23.901346 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:23.920879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c3d7c-42f2-43f7-b665-ddb9c4a5e486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:23.921527 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c3d7c-42f2-43f7-b665-ddb9c4a5e486 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:23.921813 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c3d7c-42f2-43f7-b665-ddb9c4a5e486 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:23.922094 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c3d7c-42f2-43f7-b665-ddb9c4a5e486 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:23.922827 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c3d7c-42f2-43f7-b665-ddb9c4a5e486 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:23.923134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c3d7c-42f2-43f7-b665-ddb9c4a5e486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:23.924599 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c3d7c-42f2-43f7-b665-ddb9c4a5e486 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:23.934328 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 133/265] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:23 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:23.940671 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee459979-2a83-4459-9374-08c0331a7c42 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.096030 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee459979-2a83-4459-9374-08c0331a7c42 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.143500 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed53a26-f877-4a07-bf85-3713fe5d6030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.144140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed53a26-f877-4a07-bf85-3713fe5d6030 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.144445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed53a26-f877-4a07-bf85-3713fe5d6030 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.144758 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed53a26-f877-4a07-bf85-3713fe5d6030 None admin] PATH_INFO: `/v3/users/bb7d4b7d8809451b8855c45f013fa87c` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.145977 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed53a26-f877-4a07-bf85-3713fe5d6030 None admin] RBAC: Authorizing `identity:get_user(user_id=bb7d4b7d8809451b8855c45f013fa87c)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.147454 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed53a26-f877-4a07-bf85-3713fe5d6030 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.153529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 133/266] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:23 2022] GET /identity/v3/users/bb7d4b7d8809451b8855c45f013fa87c => generated 284 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:24.160039 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c3d7c-42f2-43f7-b665-ddb9c4a5e486 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.320534 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c3d7c-42f2-43f7-b665-ddb9c4a5e486 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.369769 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b6497-a3f1-4099-9d87-d34a048cb78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.370340 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b6497-a3f1-4099-9d87-d34a048cb78b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.370621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b6497-a3f1-4099-9d87-d34a048cb78b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.370896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b6497-a3f1-4099-9d87-d34a048cb78b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.438879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:24.455853 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b6497-a3f1-4099-9d87-d34a048cb78b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.457901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b6497-a3f1-4099-9d87-d34a048cb78b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.590491 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 134/267] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:24.596771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed53a26-f877-4a07-bf85-3713fe5d6030 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.695973 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:24.771629 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89318294-c62f-41a6-906a-e3a58b7bfbb0 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.771914 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89318294-c62f-41a6-906a-e3a58b7bfbb0 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.772178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89318294-c62f-41a6-906a-e3a58b7bfbb0 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.773877 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 135/268] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:24.778346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed53a26-f877-4a07-bf85-3713fe5d6030 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.780872 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8c5a8-c27a-4a62-a648-61f9c70b5cf5 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.781157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8c5a8-c27a-4a62-a648-61f9c70b5cf5 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.781435 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8c5a8-c27a-4a62-a648-61f9c70b5cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.818051 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fa2e8-3707-4e6e-b4ed-773bef9580b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:24.820753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fa2e8-3707-4e6e-b4ed-773bef9580b4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.820753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fa2e8-3707-4e6e-b4ed-773bef9580b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.820753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fa2e8-3707-4e6e-b4ed-773bef9580b4 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.820753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fa2e8-3707-4e6e-b4ed-773bef9580b4 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:24.822005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fa2e8-3707-4e6e-b4ed-773bef9580b4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:24.825109 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-44c8c5a8-c27a-4a62-a648-61f9c70b5cf5 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:24.826310 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-44c8c5a8-c27a-4a62-a648-61f9c70b5cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:24.828252 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 134/269] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:24 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:24.831264 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fa2e8-3707-4e6e-b4ed-773bef9580b4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:24.924151 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 136/270] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:24.925516 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc7a8a-3c5c-4013-ba88-354d517dae71 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.925877 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc7a8a-3c5c-4013-ba88-354d517dae71 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.926651 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc7a8a-3c5c-4013-ba88-354d517dae71 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.928205 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 137/271] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:24.933369 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec6bc-b7fa-48c6-bff7-c0a430db0165 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:24.933759 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec6bc-b7fa-48c6-bff7-c0a430db0165 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:24.934139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ec6bc-b7fa-48c6-bff7-c0a430db0165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:24.953685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-967ec6bc-b7fa-48c6-bff7-c0a430db0165 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:24.955115 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-967ec6bc-b7fa-48c6-bff7-c0a430db0165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:24.969354 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fa2e8-3707-4e6e-b4ed-773bef9580b4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:24.970902 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:24.987189 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:25.014280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec2ae6-d9f1-4e48-b97f-b7aa2b575068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:25.015448 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec2ae6-d9f1-4e48-b97f-b7aa2b575068 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:25.015917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec2ae6-d9f1-4e48-b97f-b7aa2b575068 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:25.016398 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec2ae6-d9f1-4e48-b97f-b7aa2b575068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:25.017800 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec2ae6-d9f1-4e48-b97f-b7aa2b575068 None admin] RBAC: Adding query filter params (role.id=11db0567e2634cbb9e76b190bddd6e2a, scope.project.id=ee63142a18be4b4e894b8d8097311a63, user.id=bb7d4b7d8809451b8855c45f013fa87c) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:25.018268 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec2ae6-d9f1-4e48-b97f-b7aa2b575068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:25.020036 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec2ae6-d9f1-4e48-b97f-b7aa2b575068 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:25.030282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 135/272] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:24 2022] GET /identity/v3/role_assignments?user.id=bb7d4b7d8809451b8855c45f013fa87c&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=11db0567e2634cbb9e76b190bddd6e2a => generated 610 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:25.031396 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec2ae6-d9f1-4e48-b97f-b7aa2b575068 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:25.042977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 138/273] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:25.075645 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ec6bc-b7fa-48c6-bff7-c0a430db0165 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:25.235651 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec2ae6-d9f1-4e48-b97f-b7aa2b575068 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:25.271567 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ec6bc-b7fa-48c6-bff7-c0a430db0165 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:25.273042 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ec240-ac80-46bb-abe4-f51a0b7999ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:25.273821 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ec240-ac80-46bb-abe4-f51a0b7999ea None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:25.274211 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ec240-ac80-46bb-abe4-f51a0b7999ea None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:25.274590 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ec240-ac80-46bb-abe4-f51a0b7999ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:25.288797 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ec240-ac80-46bb-abe4-f51a0b7999ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-e66ec240-ac80-46bb-abe4-f51a0b7999ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:25.299873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:25.301388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:25.302190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:25.303773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 136/274] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:25.308419 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ec240-ac80-46bb-abe4-f51a0b7999ea None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:25.328185 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144ab9e-d635-492d-a749-bdda57ed4602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:25.329352 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144ab9e-d635-492d-a749-bdda57ed4602 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:25.329840 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144ab9e-d635-492d-a749-bdda57ed4602 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:25.330339 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144ab9e-d635-492d-a749-bdda57ed4602 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:25.331834 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144ab9e-d635-492d-a749-bdda57ed4602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:25.334145 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144ab9e-d635-492d-a749-bdda57ed4602 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:25.336637 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 139/275] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:25 2022] GET /identity/v3/domains/default => generated 200 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:25.342609 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144ab9e-d635-492d-a749-bdda57ed4602 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:25.366119 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:25.467679 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144ab9e-d635-492d-a749-bdda57ed4602 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:25.471185 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:25.524766 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd902b3-b8f4-43f8-866f-dcbc3c99f359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:25.525979 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd902b3-b8f4-43f8-866f-dcbc3c99f359 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:25.525979 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd902b3-b8f4-43f8-866f-dcbc3c99f359 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:25.525979 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd902b3-b8f4-43f8-866f-dcbc3c99f359 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:25.526618 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd902b3-b8f4-43f8-866f-dcbc3c99f359 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:25.528082 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd902b3-b8f4-43f8-866f-dcbc3c99f359 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:25.564397 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ec240-ac80-46bb-abe4-f51a0b7999ea None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:25.601159 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172823a5-e5b6-467f-9299-89196fd8826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:25.601780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172823a5-e5b6-467f-9299-89196fd8826c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:25.602071 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172823a5-e5b6-467f-9299-89196fd8826c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:25.602348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172823a5-e5b6-467f-9299-89196fd8826c None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:25.603063 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172823a5-e5b6-467f-9299-89196fd8826c None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:25.603370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172823a5-e5b6-467f-9299-89196fd8826c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:25.604794 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172823a5-e5b6-467f-9299-89196fd8826c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:25.613541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 137/276] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:25 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:25.619117 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172823a5-e5b6-467f-9299-89196fd8826c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:25.657599 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 140/277] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:11:25 2022] POST /identity/v3/users => generated 294 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:25.757187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172823a5-e5b6-467f-9299-89196fd8826c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:25.759032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:25.796099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1825058-caa1-4079-b313-ded993576140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:25.796808 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825058-caa1-4079-b313-ded993576140 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:25.797091 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825058-caa1-4079-b313-ded993576140 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:25.797372 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1825058-caa1-4079-b313-ded993576140 None admin] PATH_INFO: `/v3/users/a82429d16dcc4a5ab2a86a1f913c2e79` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:25.814142 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1825058-caa1-4079-b313-ded993576140 None admin] RBAC: Authorizing `identity:get_user(user_id=a82429d16dcc4a5ab2a86a1f913c2e79)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:25.815651 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1825058-caa1-4079-b313-ded993576140 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:25.818486 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e117d-b461-43cc-b654-e22b277a2c8c None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:25.818765 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e117d-b461-43cc-b654-e22b277a2c8c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:25.819049 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e117d-b461-43cc-b654-e22b277a2c8c None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:25.820157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 138/278] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:25 2022] GET /identity/v3/users/a82429d16dcc4a5ab2a86a1f913c2e79 => generated 294 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:25.826017 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 141/279] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:25 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:25.826847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1825058-caa1-4079-b313-ded993576140 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:25.833648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b330135-923d-4d73-8759-f3c1e199adb9 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:25.834259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b330135-923d-4d73-8759-f3c1e199adb9 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:25.834742 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b330135-923d-4d73-8759-f3c1e199adb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:25.861194 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-5b330135-923d-4d73-8759-f3c1e199adb9 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:25.862921 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-5b330135-923d-4d73-8759-f3c1e199adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:25.955535 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1825058-caa1-4079-b313-ded993576140 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:25.961867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 142/280] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:25.989024 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b330135-923d-4d73-8759-f3c1e199adb9 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:25.991553 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:26.001572 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b42d91-af94-4d6a-a5b5-31b912d22725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:26.002502 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b42d91-af94-4d6a-a5b5-31b912d22725 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:26.002783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b42d91-af94-4d6a-a5b5-31b912d22725 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:26.003058 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b42d91-af94-4d6a-a5b5-31b912d22725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:26.005268 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b42d91-af94-4d6a-a5b5-31b912d22725 None admin] RBAC: Adding query filter params (role.id=7b33619ed33f41c0b797124afa4a385d, user.id=a82429d16dcc4a5ab2a86a1f913c2e79, scope.system=all) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:26.005268 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b42d91-af94-4d6a-a5b5-31b912d22725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:26.007293 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b42d91-af94-4d6a-a5b5-31b912d22725 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:26.015058 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 139/281] 10.222.0.100 () {56 vars in 1313 bytes} [Tue Jul 26 15:11:25 2022] GET /identity/v3/role_assignments?user.id=a82429d16dcc4a5ab2a86a1f913c2e79&scope.system=all&role.id=7b33619ed33f41c0b797124afa4a385d => generated 227 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:26.135028 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b330135-923d-4d73-8759-f3c1e199adb9 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:26.173962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a4443-75d7-4cee-8733-f4429c8343ce None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:26.174266 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a4443-75d7-4cee-8733-f4429c8343ce None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:26.174705 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a4443-75d7-4cee-8733-f4429c8343ce None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:26.176090 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 140/282] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:26.177787 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fa434-0aab-43b3-b1ab-d898a2b6e140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:26.178659 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fa434-0aab-43b3-b1ab-d898a2b6e140 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:26.182379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fa434-0aab-43b3-b1ab-d898a2b6e140 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:26.182379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fa434-0aab-43b3-b1ab-d898a2b6e140 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:26.182565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cff9a8-fe98-4d7c-92ae-d4473bb81cf5 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:26.182565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cff9a8-fe98-4d7c-92ae-d4473bb81cf5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:26.182565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cff9a8-fe98-4d7c-92ae-d4473bb81cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:26.197938 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fa434-0aab-43b3-b1ab-d898a2b6e140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-8c5fa434-0aab-43b3-b1ab-d898a2b6e140 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:26.203029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:26.204003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:26.204856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 143/283] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:26.211143 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-23cff9a8-fe98-4d7c-92ae-d4473bb81cf5 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:26.212762 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-23cff9a8-fe98-4d7c-92ae-d4473bb81cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:26.212987 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fa434-0aab-43b3-b1ab-d898a2b6e140 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:26.231910 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:26.287176 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:26.304559 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 141/284] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:26.333999 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fa434-0aab-43b3-b1ab-d898a2b6e140 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:26.340276 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cff9a8-fe98-4d7c-92ae-d4473bb81cf5 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:26.370943 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d1d49-c399-40bd-aa86-c5b152f9ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:26.371811 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d1d49-c399-40bd-aa86-c5b152f9ddbb None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:26.372273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d1d49-c399-40bd-aa86-c5b152f9ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:26.372690 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d1d49-c399-40bd-aa86-c5b152f9ddbb None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:26.373583 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d1d49-c399-40bd-aa86-c5b152f9ddbb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:26.374036 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d1d49-c399-40bd-aa86-c5b152f9ddbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:26.375581 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d1d49-c399-40bd-aa86-c5b152f9ddbb None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:26.385610 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 144/285] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:26 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:26.393504 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d1d49-c399-40bd-aa86-c5b152f9ddbb None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:26.535952 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cff9a8-fe98-4d7c-92ae-d4473bb81cf5 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:26.575780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281edd-62cd-41c1-9bd1-848e0cc5d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:26.576359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281edd-62cd-41c1-9bd1-848e0cc5d24e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:26.576638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281edd-62cd-41c1-9bd1-848e0cc5d24e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:26.576908 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281edd-62cd-41c1-9bd1-848e0cc5d24e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:26.597251 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281edd-62cd-41c1-9bd1-848e0cc5d24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-39281edd-62cd-41c1-9bd1-848e0cc5d24e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:26.602173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:26.603074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:26.603873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 142/286] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:26.610828 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281edd-62cd-41c1-9bd1-848e0cc5d24e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:26.613448 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d1d49-c399-40bd-aa86-c5b152f9ddbb None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:26.627411 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:26.670193 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:26.701746 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4039e6-3583-46be-b467-0a87fe5cdad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:26.702412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4039e6-3583-46be-b467-0a87fe5cdad3 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:26.702697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4039e6-3583-46be-b467-0a87fe5cdad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:26.702977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4039e6-3583-46be-b467-0a87fe5cdad3 None admin] PATH_INFO: `/v3/users/ac3f45a507654cd6a8a48cc4fbf65059` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:26.704255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4039e6-3583-46be-b467-0a87fe5cdad3 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3f45a507654cd6a8a48cc4fbf65059)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:26.705724 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4039e6-3583-46be-b467-0a87fe5cdad3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:26.708187 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 145/287] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:26 2022] GET /identity/v3/users/ac3f45a507654cd6a8a48cc4fbf65059 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:26.723766 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4039e6-3583-46be-b467-0a87fe5cdad3 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:26.730463 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281edd-62cd-41c1-9bd1-848e0cc5d24e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:26.772439 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb6275-eea9-45be-9a3f-44fd22069746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:26.773054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb6275-eea9-45be-9a3f-44fd22069746 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:26.773333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb6275-eea9-45be-9a3f-44fd22069746 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:26.773604 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb6275-eea9-45be-9a3f-44fd22069746 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:26.774314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb6275-eea9-45be-9a3f-44fd22069746 None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:26.774613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb6275-eea9-45be-9a3f-44fd22069746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:26.775990 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb6275-eea9-45be-9a3f-44fd22069746 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:26.792709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 143/288] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:26 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:26.798180 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb6275-eea9-45be-9a3f-44fd22069746 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:26.922121 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:26.929346 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4039e6-3583-46be-b467-0a87fe5cdad3 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:26.975940 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb6275-eea9-45be-9a3f-44fd22069746 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:26.997532 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c427b-555f-4b97-b486-9a050edca711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:26.998199 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c427b-555f-4b97-b486-9a050edca711 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:26.998459 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c427b-555f-4b97-b486-9a050edca711 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:26.998733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c427b-555f-4b97-b486-9a050edca711 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:27.000876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c427b-555f-4b97-b486-9a050edca711 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:27.002351 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c427b-555f-4b97-b486-9a050edca711 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:27.004453 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 146/289] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:26 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:27.010163 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c427b-555f-4b97-b486-9a050edca711 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:27.025783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38ce87-383f-42c2-842c-fa9c84b2f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:27.026754 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38ce87-383f-42c2-842c-fa9c84b2f087 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:27.027257 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38ce87-383f-42c2-842c-fa9c84b2f087 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:27.027750 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38ce87-383f-42c2-842c-fa9c84b2f087 None admin] PATH_INFO: `/v3/users/179ad6a395e44affa6e19e8777db3dff` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:27.029173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38ce87-383f-42c2-842c-fa9c84b2f087 None admin] RBAC: Authorizing `identity:get_user(user_id=179ad6a395e44affa6e19e8777db3dff)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:27.030933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a38ce87-383f-42c2-842c-fa9c84b2f087 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:27.036698 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 144/290] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:26 2022] GET /identity/v3/users/179ad6a395e44affa6e19e8777db3dff => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:27.042663 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38ce87-383f-42c2-842c-fa9c84b2f087 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:27.123890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:27.207368 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c427b-555f-4b97-b486-9a050edca711 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:27.232690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38ce87-383f-42c2-842c-fa9c84b2f087 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:27.284478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a6722-c1f0-41a7-ad2a-edd04049cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:27.285683 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a6722-c1f0-41a7-ad2a-edd04049cef9 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:27.286271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a6722-c1f0-41a7-ad2a-edd04049cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:27.286762 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a6722-c1f0-41a7-ad2a-edd04049cef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:27.293853 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f2342-b64a-42d1-87fd-25ea767228ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:27.294842 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f2342-b64a-42d1-87fd-25ea767228ba None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:27.295263 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f2342-b64a-42d1-87fd-25ea767228ba None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:27.295671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f2342-b64a-42d1-87fd-25ea767228ba None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63/users/ac3f45a507654cd6a8a48cc4fbf65059/roles/4ff172ce2b424a9589c1730145dd135e` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:27.300242 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:27.305343 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f2342-b64a-42d1-87fd-25ea767228ba None admin] RBAC: Authorizing `identity:create_grant(project_id=ee63142a18be4b4e894b8d8097311a63, user_id=ac3f45a507654cd6a8a48cc4fbf65059, role_id=4ff172ce2b424a9589c1730145dd135e)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:27.307609 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f2342-b64a-42d1-87fd-25ea767228ba None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:27.361204 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a6722-c1f0-41a7-ad2a-edd04049cef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:27.363054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a6722-c1f0-41a7-ad2a-edd04049cef9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:27.473809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 145/291] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:27.480933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a6722-c1f0-41a7-ad2a-edd04049cef9 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:27.494804 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 147/292] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:11:27 2022] PUT /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63/users/ac3f45a507654cd6a8a48cc4fbf65059/roles/4ff172ce2b424a9589c1730145dd135e => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:27.554951 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:27.643078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a6722-c1f0-41a7-ad2a-edd04049cef9 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:27.685034 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03c03c-4dc2-41e0-84c2-9a169fabe667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:27.685695 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c03c-4dc2-41e0-84c2-9a169fabe667 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:27.685975 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c03c-4dc2-41e0-84c2-9a169fabe667 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:27.686262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03c03c-4dc2-41e0-84c2-9a169fabe667 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:27.687453 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03c03c-4dc2-41e0-84c2-9a169fabe667 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:27.688964 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03c03c-4dc2-41e0-84c2-9a169fabe667 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:27.690657 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 146/293] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:27 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:27.697552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f2342-b64a-42d1-87fd-25ea767228ba None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:27.807534 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f2342-b64a-42d1-87fd-25ea767228ba None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:27.828821 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:27.854528 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a212536-5285-4686-b739-ecbf637685b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:27.855529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a212536-5285-4686-b739-ecbf637685b7 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:27.856007 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a212536-5285-4686-b739-ecbf637685b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:27.856504 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a212536-5285-4686-b739-ecbf637685b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:27.857537 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a212536-5285-4686-b739-ecbf637685b7 None admin] RBAC: Adding query filter params (role.id=7b33619ed33f41c0b797124afa4a385d, scope.project.id=ee63142a18be4b4e894b8d8097311a63, user.id=179ad6a395e44affa6e19e8777db3dff) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:27.858121 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a212536-5285-4686-b739-ecbf637685b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:27.859933 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a212536-5285-4686-b739-ecbf637685b7 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:27.871936 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 148/294] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:27 2022] GET /identity/v3/role_assignments?user.id=179ad6a395e44affa6e19e8777db3dff&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=7b33619ed33f41c0b797124afa4a385d => generated 610 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:28.454468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf080-2634-446c-b2b8-44bafd2ebb9d None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.455069 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf080-2634-446c-b2b8-44bafd2ebb9d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.455069 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bf080-2634-446c-b2b8-44bafd2ebb9d None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.456380 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 147/295] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:28.461856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218ca91-5e8b-4452-901b-910f42031e02 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.462272 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218ca91-5e8b-4452-901b-910f42031e02 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.462448 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218ca91-5e8b-4452-901b-910f42031e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.500875 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-d218ca91-5e8b-4452-901b-910f42031e02 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:28.502150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-d218ca91-5e8b-4452-901b-910f42031e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:28.596649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 149/296] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:28.624182 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf080-2634-446c-b2b8-44bafd2ebb9d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:28.675161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa71fc6-121e-41bb-9f97-143c7e748a29 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.675642 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa71fc6-121e-41bb-9f97-143c7e748a29 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.676480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa71fc6-121e-41bb-9f97-143c7e748a29 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.677868 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 150/297] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:28 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:28.683254 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf9ad1-a672-4514-b908-1fec5f9cd9a3 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.683542 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf9ad1-a672-4514-b908-1fec5f9cd9a3 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.683822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf9ad1-a672-4514-b908-1fec5f9cd9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.703127 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-f4cf9ad1-a672-4514-b908-1fec5f9cd9a3 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:28.704535 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f4cf9ad1-a672-4514-b908-1fec5f9cd9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:28.749336 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bf080-2634-446c-b2b8-44bafd2ebb9d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:28.758874 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:28.780132 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 151/298] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:28.781646 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4ec4-1dd0-4e99-b453-b441c0c08c02 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.782007 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4ec4-1dd0-4e99-b453-b441c0c08c02 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.782358 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead4ec4-1dd0-4e99-b453-b441c0c08c02 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.783821 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 152/299] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:28.789581 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5b8f5-6430-4050-9dd8-06af17edc2b6 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.789872 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5b8f5-6430-4050-9dd8-06af17edc2b6 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.789979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9eeb-6938-4572-bf56-418b62dfad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:28.790165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5b8f5-6430-4050-9dd8-06af17edc2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.791000 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9eeb-6938-4572-bf56-418b62dfad1e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.791491 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9eeb-6938-4572-bf56-418b62dfad1e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.792249 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9eeb-6938-4572-bf56-418b62dfad1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.804384 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f9eeb-6938-4572-bf56-418b62dfad1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:28.809498 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-cee5b8f5-6430-4050-9dd8-06af17edc2b6 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-c15f9eeb-6938-4572-bf56-418b62dfad1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:28.809936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:28.810824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:28.811659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:28.812316 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-cee5b8f5-6430-4050-9dd8-06af17edc2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:28.813914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 148/300] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:28.814615 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9eeb-6938-4572-bf56-418b62dfad1e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:28.859757 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:28.887763 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 153/301] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:28.888657 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5b8f5-6430-4050-9dd8-06af17edc2b6 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:28.933485 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9eeb-6938-4572-bf56-418b62dfad1e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:28.982796 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c8ce6-d8a0-4a99-89c1-7ac99c781455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:28.983638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c8ce6-d8a0-4a99-89c1-7ac99c781455 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:28.984057 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c8ce6-d8a0-4a99-89c1-7ac99c781455 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:28.984516 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c8ce6-d8a0-4a99-89c1-7ac99c781455 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:28.986235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c8ce6-d8a0-4a99-89c1-7ac99c781455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:28.988555 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c8ce6-d8a0-4a99-89c1-7ac99c781455 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:28.991025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 149/302] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:28 2022] GET /identity/v3/domains/default => generated 200 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:28.992059 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c8ce6-d8a0-4a99-89c1-7ac99c781455 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.021733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5b8f5-6430-4050-9dd8-06af17edc2b6 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.038749 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:29.058354 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c448f-70af-4a00-982d-6ce20d14426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.058985 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c448f-70af-4a00-982d-6ce20d14426b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.059270 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c448f-70af-4a00-982d-6ce20d14426b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.059606 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c448f-70af-4a00-982d-6ce20d14426b None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.060358 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c448f-70af-4a00-982d-6ce20d14426b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:29.060661 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c448f-70af-4a00-982d-6ce20d14426b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.062054 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c448f-70af-4a00-982d-6ce20d14426b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.071159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 154/303] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:28 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:29.071959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c448f-70af-4a00-982d-6ce20d14426b None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.113018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:29.114593 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c8ce6-d8a0-4a99-89c1-7ac99c781455 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.149612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746aa29-7487-4f13-8f50-d38e7bd81cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.150247 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746aa29-7487-4f13-8f50-d38e7bd81cb0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.150524 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746aa29-7487-4f13-8f50-d38e7bd81cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.150799 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746aa29-7487-4f13-8f50-d38e7bd81cb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.161631 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746aa29-7487-4f13-8f50-d38e7bd81cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-d746aa29-7487-4f13-8f50-d38e7bd81cb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:29.167223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:29.168157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:29.168976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 150/304] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:29.169679 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746aa29-7487-4f13-8f50-d38e7bd81cb0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.189945 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c448f-70af-4a00-982d-6ce20d14426b None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.226603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261b25b-8189-4b2f-ae33-10d2b5699451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.227234 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b25b-8189-4b2f-ae33-10d2b5699451 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.227502 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b25b-8189-4b2f-ae33-10d2b5699451 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.227773 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261b25b-8189-4b2f-ae33-10d2b5699451 None admin] PATH_INFO: `/v3/groups` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.228459 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261b25b-8189-4b2f-ae33-10d2b5699451 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.229892 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261b25b-8189-4b2f-ae33-10d2b5699451 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.270469 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:29.276470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746aa29-7487-4f13-8f50-d38e7bd81cb0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.299175 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 155/305] 10.222.0.100 () {60 vars in 1139 bytes} [Tue Jul 26 15:11:29 2022] POST /identity/v3/groups => generated 230 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:29.300311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261b25b-8189-4b2f-ae33-10d2b5699451 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.323917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dfe23-9baf-4f56-b4b1-e386ff058cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.325002 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dfe23-9baf-4f56-b4b1-e386ff058cca None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.325546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dfe23-9baf-4f56-b4b1-e386ff058cca None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.326064 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dfe23-9baf-4f56-b4b1-e386ff058cca None admin] PATH_INFO: `/v3/users/166cae82b4064723a13209f9314fb6ca` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.344699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dfe23-9baf-4f56-b4b1-e386ff058cca None admin] RBAC: Authorizing `identity:get_user(user_id=166cae82b4064723a13209f9314fb6ca)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.346995 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dfe23-9baf-4f56-b4b1-e386ff058cca None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.350357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 151/306] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:29 2022] GET /identity/v3/users/166cae82b4064723a13209f9314fb6ca => generated 294 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:29.356552 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dfe23-9baf-4f56-b4b1-e386ff058cca None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.461916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:29.471477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261b25b-8189-4b2f-ae33-10d2b5699451 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.482642 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dfe23-9baf-4f56-b4b1-e386ff058cca None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.532025 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288cb3e-0d36-4a2d-914c-8f6537f72a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.532639 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288cb3e-0d36-4a2d-914c-8f6537f72a2a None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.532926 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288cb3e-0d36-4a2d-914c-8f6537f72a2a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.533208 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288cb3e-0d36-4a2d-914c-8f6537f72a2a None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.533934 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288cb3e-0d36-4a2d-914c-8f6537f72a2a None admin] RBAC: Adding query filter params (name=member) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:29.534243 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288cb3e-0d36-4a2d-914c-8f6537f72a2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.534993 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770256a8-7d8a-488a-9ce9-eb64881e6267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.535607 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770256a8-7d8a-488a-9ce9-eb64881e6267 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.535705 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288cb3e-0d36-4a2d-914c-8f6537f72a2a None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.535891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770256a8-7d8a-488a-9ce9-eb64881e6267 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.536242 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770256a8-7d8a-488a-9ce9-eb64881e6267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.537033 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770256a8-7d8a-488a-9ce9-eb64881e6267 None admin] RBAC: Adding query filter params (role.id=4ff172ce2b424a9589c1730145dd135e, user.id=166cae82b4064723a13209f9314fb6ca, scope.system=all) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:29.537554 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770256a8-7d8a-488a-9ce9-eb64881e6267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.539384 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770256a8-7d8a-488a-9ce9-eb64881e6267 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.546122 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 152/307] 10.222.0.100 () {56 vars in 1313 bytes} [Tue Jul 26 15:11:29 2022] GET /identity/v3/role_assignments?user.id=166cae82b4064723a13209f9314fb6ca&scope.system=all&role.id=4ff172ce2b424a9589c1730145dd135e => generated 227 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:29.548077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 156/308] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:29 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:29.554300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770256a8-7d8a-488a-9ce9-eb64881e6267 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.577659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:29.673059 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770256a8-7d8a-488a-9ce9-eb64881e6267 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.712454 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980218e-cc0f-430c-8aaf-948dde191acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.713113 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980218e-cc0f-430c-8aaf-948dde191acf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.713397 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980218e-cc0f-430c-8aaf-948dde191acf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.713774 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980218e-cc0f-430c-8aaf-948dde191acf None admin] PATH_INFO: `/v3/users/a82429d16dcc4a5ab2a86a1f913c2e79` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.715869 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980218e-cc0f-430c-8aaf-948dde191acf None admin] RBAC: Authorizing `identity:get_user(user_id=a82429d16dcc4a5ab2a86a1f913c2e79)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.718715 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980218e-cc0f-430c-8aaf-948dde191acf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.724206 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 153/309] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:29 2022] GET /identity/v3/users/a82429d16dcc4a5ab2a86a1f913c2e79 => generated 294 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:29.733857 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288cb3e-0d36-4a2d-914c-8f6537f72a2a None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:29.846406 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288cb3e-0d36-4a2d-914c-8f6537f72a2a None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:29.884143 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638ac1-8c39-4909-b7a4-951e942e1c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:29.884854 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638ac1-8c39-4909-b7a4-951e942e1c38 None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:29.885140 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638ac1-8c39-4909-b7a4-951e942e1c38 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:29.885424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638ac1-8c39-4909-b7a4-951e942e1c38 None admin] PATH_INFO: `/v3/system/users/a82429d16dcc4a5ab2a86a1f913c2e79/roles/7b33619ed33f41c0b797124afa4a385d` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:29.887130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638ac1-8c39-4909-b7a4-951e942e1c38 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a82429d16dcc4a5ab2a86a1f913c2e79, role_id=7b33619ed33f41c0b797124afa4a385d)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:29.888601 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638ac1-8c39-4909-b7a4-951e942e1c38 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:29.979456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 157/310] 10.222.0.100 () {58 vars in 1339 bytes} [Tue Jul 26 15:11:29 2022] PUT /identity/v3/system/users/a82429d16dcc4a5ab2a86a1f913c2e79/roles/7b33619ed33f41c0b797124afa4a385d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:30.050362 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559bcd2-caad-4eb5-9634-4218663dcdef None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.051235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559bcd2-caad-4eb5-9634-4218663dcdef None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.051455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559bcd2-caad-4eb5-9634-4218663dcdef None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.053272 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 154/311] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:30.058998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9bbf6-f595-477b-946a-e09611c5809b None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.059322 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9bbf6-f595-477b-946a-e09611c5809b None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.059564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9bbf6-f595-477b-946a-e09611c5809b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.080648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-6be9bbf6-f595-477b-946a-e09611c5809b None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:30.082009 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-6be9bbf6-f595-477b-946a-e09611c5809b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:30.101760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:30.159580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 158/312] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:30.186329 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559bcd2-caad-4eb5-9634-4218663dcdef None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:30.279380 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:30.296085 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559bcd2-caad-4eb5-9634-4218663dcdef None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.332412 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e00325-4807-41a7-8458-20a9ba96fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.333054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e00325-4807-41a7-8458-20a9ba96fe60 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.333901 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e00325-4807-41a7-8458-20a9ba96fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.334179 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e00325-4807-41a7-8458-20a9ba96fe60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.344849 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e00325-4807-41a7-8458-20a9ba96fe60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-59e00325-4807-41a7-8458-20a9ba96fe60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:30.349914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:30.350809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:30.351628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 155/313] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:30.357133 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9bbf6-f595-477b-946a-e09611c5809b None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:30.464106 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9bbf6-f595-477b-946a-e09611c5809b None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.506434 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dac87d-004c-4751-83ac-d05a4bf91318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.507389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dac87d-004c-4751-83ac-d05a4bf91318 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.507902 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dac87d-004c-4751-83ac-d05a4bf91318 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.508411 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dac87d-004c-4751-83ac-d05a4bf91318 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.509331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dac87d-004c-4751-83ac-d05a4bf91318 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:30.509864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dac87d-004c-4751-83ac-d05a4bf91318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:30.511448 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dac87d-004c-4751-83ac-d05a4bf91318 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:30.525221 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 159/314] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:30 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:30.526854 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e00325-4807-41a7-8458-20a9ba96fe60 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:30.634355 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e00325-4807-41a7-8458-20a9ba96fe60 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.672888 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec38d-88c6-4e7c-b43d-46d3984fa947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.673943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec38d-88c6-4e7c-b43d-46d3984fa947 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.674453 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec38d-88c6-4e7c-b43d-46d3984fa947 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.674928 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faec38d-88c6-4e7c-b43d-46d3984fa947 None admin] PATH_INFO: `/v3/users/ac3f45a507654cd6a8a48cc4fbf65059` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.676905 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec38d-88c6-4e7c-b43d-46d3984fa947 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3f45a507654cd6a8a48cc4fbf65059)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:30.678554 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faec38d-88c6-4e7c-b43d-46d3984fa947 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:30.684277 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 156/315] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:30 2022] GET /identity/v3/users/ac3f45a507654cd6a8a48cc4fbf65059 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:30.686605 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dac87d-004c-4751-83ac-d05a4bf91318 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:30.706052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:30.797027 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dac87d-004c-4751-83ac-d05a4bf91318 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:30.833146 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2872377-f823-4967-a46f-e4c5ecb37399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:30.834032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2872377-f823-4967-a46f-e4c5ecb37399 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:30.834360 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2872377-f823-4967-a46f-e4c5ecb37399 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:30.834634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2872377-f823-4967-a46f-e4c5ecb37399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:30.905084 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2872377-f823-4967-a46f-e4c5ecb37399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:30.906476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2872377-f823-4967-a46f-e4c5ecb37399 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:30.924858 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:31.015829 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 160/316] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:31.022298 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec38d-88c6-4e7c-b43d-46d3984fa947 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:31.040507 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:31.125672 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faec38d-88c6-4e7c-b43d-46d3984fa947 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:31.162259 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72744152-c68f-4ae9-a65e-fbea3b2c4915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:31.163298 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72744152-c68f-4ae9-a65e-fbea3b2c4915 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.163804 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72744152-c68f-4ae9-a65e-fbea3b2c4915 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.164315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72744152-c68f-4ae9-a65e-fbea3b2c4915 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.165818 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72744152-c68f-4ae9-a65e-fbea3b2c4915 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:31.167892 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72744152-c68f-4ae9-a65e-fbea3b2c4915 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:31.175099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 157/317] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:31 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:31.177446 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2872377-f823-4967-a46f-e4c5ecb37399 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:31.283176 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2872377-f823-4967-a46f-e4c5ecb37399 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:31.301757 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:31.331175 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ad25f-1ccb-49a8-8f1c-fdf880c4376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:31.331843 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ad25f-1ccb-49a8-8f1c-fdf880c4376a None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.332145 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ad25f-1ccb-49a8-8f1c-fdf880c4376a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.332433 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ad25f-1ccb-49a8-8f1c-fdf880c4376a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.333226 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ad25f-1ccb-49a8-8f1c-fdf880c4376a None admin] RBAC: Adding query filter params (role.id=4ff172ce2b424a9589c1730145dd135e, scope.project.id=ee63142a18be4b4e894b8d8097311a63, user.id=ac3f45a507654cd6a8a48cc4fbf65059) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:31.333533 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ad25f-1ccb-49a8-8f1c-fdf880c4376a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:31.335104 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ad25f-1ccb-49a8-8f1c-fdf880c4376a None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:31.341959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 161/318] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:31 2022] GET /identity/v3/role_assignments?user.id=ac3f45a507654cd6a8a48cc4fbf65059&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=4ff172ce2b424a9589c1730145dd135e => generated 610 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:31.745111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0347c-29f3-4bf4-a8a7-89cd8dbc5159 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.745600 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0347c-29f3-4bf4-a8a7-89cd8dbc5159 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.745600 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d0347c-29f3-4bf4-a8a7-89cd8dbc5159 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.747247 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 158/319] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:31.752201 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602cc53-e839-4d97-a355-fa08c0ac9114 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.752609 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602cc53-e839-4d97-a355-fa08c0ac9114 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.752770 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602cc53-e839-4d97-a355-fa08c0ac9114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.783795 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-2602cc53-e839-4d97-a355-fa08c0ac9114 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:31.786004 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-2602cc53-e839-4d97-a355-fa08c0ac9114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:31.855932 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 162/320] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:31.880165 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0347c-29f3-4bf4-a8a7-89cd8dbc5159 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:31.932134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef25c7-5831-480a-8038-f6ce0bb50b35 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.932454 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef25c7-5831-480a-8038-f6ce0bb50b35 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.932730 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef25c7-5831-480a-8038-f6ce0bb50b35 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.934093 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 163/321] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:31.940059 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ae33b-198e-4ef7-ba94-07500f0d039f None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:31.940374 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ae33b-198e-4ef7-ba94-07500f0d039f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:31.940576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ae33b-198e-4ef7-ba94-07500f0d039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:31.960852 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-b69ae33b-198e-4ef7-ba94-07500f0d039f None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:31.962290 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-b69ae33b-198e-4ef7-ba94-07500f0d039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:31.972493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:31.993547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d0347c-29f3-4bf4-a8a7-89cd8dbc5159 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.030407 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739ce3e-8645-41cf-8893-3726aa9c6f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.030976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ce3e-8645-41cf-8893-3726aa9c6f88 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.031252 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ce3e-8645-41cf-8893-3726aa9c6f88 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.031529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ce3e-8645-41cf-8893-3726aa9c6f88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.032853 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739ce3e-8645-41cf-8893-3726aa9c6f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:32.034339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739ce3e-8645-41cf-8893-3726aa9c6f88 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.040175 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 159/322] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:31 2022] GET /identity/v3/domains/default => generated 200 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:32.042700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739ce3e-8645-41cf-8893-3726aa9c6f88 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.043656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 164/323] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:32.071081 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ae33b-198e-4ef7-ba94-07500f0d039f None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.112275 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:32.155624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739ce3e-8645-41cf-8893-3726aa9c6f88 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.181336 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ae33b-198e-4ef7-ba94-07500f0d039f None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.194714 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0679272-aa06-401d-af52-6fa609741dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.195448 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0679272-aa06-401d-af52-6fa609741dff None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.195729 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0679272-aa06-401d-af52-6fa609741dff None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.195996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0679272-aa06-401d-af52-6fa609741dff None admin] PATH_INFO: `/v3/groups` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.196723 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0679272-aa06-401d-af52-6fa609741dff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:32.198190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0679272-aa06-401d-af52-6fa609741dff None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.223140 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0ed23-b836-4ea8-ad59-9232434166c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.223786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0ed23-b836-4ea8-ad59-9232434166c8 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.224063 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0ed23-b836-4ea8-ad59-9232434166c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.226207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0ed23-b836-4ea8-ad59-9232434166c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.235099 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0ed23-b836-4ea8-ad59-9232434166c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-37c0ed23-b836-4ea8-ad59-9232434166c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:32.240665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:32.241621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:32.242456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 165/324] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:32.247406 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0ed23-b836-4ea8-ad59-9232434166c8 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.305423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 160/325] 10.222.0.100 () {60 vars in 1139 bytes} [Tue Jul 26 15:11:32 2022] POST /identity/v3/groups => generated 227 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:32.350175 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ca6b-d6d2-485c-9332-44134860f0f9 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.350458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ca6b-d6d2-485c-9332-44134860f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.350731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ca6b-d6d2-485c-9332-44134860f0f9 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.352072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 161/326] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:32.354328 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:32.357899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f95ed5-e00b-4ade-836d-952386e9e70f None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.358185 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f95ed5-e00b-4ade-836d-952386e9e70f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.358462 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f95ed5-e00b-4ade-836d-952386e9e70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.359184 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0ed23-b836-4ea8-ad59-9232434166c8 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.384814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-e2f95ed5-e00b-4ade-836d-952386e9e70f None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:32.386120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e2f95ed5-e00b-4ade-836d-952386e9e70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:32.390557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:32.416304 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbda71-ea80-4753-aa57-3cba2ea28f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.417559 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbda71-ea80-4753-aa57-3cba2ea28f89 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.418044 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbda71-ea80-4753-aa57-3cba2ea28f89 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.418492 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbda71-ea80-4753-aa57-3cba2ea28f89 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.419380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbda71-ea80-4753-aa57-3cba2ea28f89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:32.419858 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbda71-ea80-4753-aa57-3cba2ea28f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:32.421497 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dbda71-ea80-4753-aa57-3cba2ea28f89 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.440435 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 166/327] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:32 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:32.442867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbda71-ea80-4753-aa57-3cba2ea28f89 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.481385 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 162/328] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:32.506568 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f95ed5-e00b-4ade-836d-952386e9e70f None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.571207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbda71-ea80-4753-aa57-3cba2ea28f89 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.618027 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba8560-0d52-44a8-b70a-7874c6702b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.619131 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba8560-0d52-44a8-b70a-7874c6702b47 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.619574 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba8560-0d52-44a8-b70a-7874c6702b47 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.619863 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba8560-0d52-44a8-b70a-7874c6702b47 None admin] PATH_INFO: `/v3/users/166cae82b4064723a13209f9314fb6ca` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.621090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba8560-0d52-44a8-b70a-7874c6702b47 None admin] RBAC: Authorizing `identity:get_user(user_id=166cae82b4064723a13209f9314fb6ca)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:32.622546 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba8560-0d52-44a8-b70a-7874c6702b47 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.624353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 167/329] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:32 2022] GET /identity/v3/users/166cae82b4064723a13209f9314fb6ca => generated 294 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:32.630267 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba8560-0d52-44a8-b70a-7874c6702b47 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.632850 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f95ed5-e00b-4ade-836d-952386e9e70f None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.668010 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:32.679708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a75170-c50b-4a22-a581-23a5372b19b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.681080 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a75170-c50b-4a22-a581-23a5372b19b3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.681080 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a75170-c50b-4a22-a581-23a5372b19b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.681391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a75170-c50b-4a22-a581-23a5372b19b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.690500 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:32.693712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a75170-c50b-4a22-a581-23a5372b19b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-a1a75170-c50b-4a22-a581-23a5372b19b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:32.699747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:32.700699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:32.701612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 163/330] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:32.709553 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a75170-c50b-4a22-a581-23a5372b19b3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.767815 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba8560-0d52-44a8-b70a-7874c6702b47 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.819625 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4037ed-6c49-419d-833a-153881374aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.821117 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4037ed-6c49-419d-833a-153881374aa1 None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.821117 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4037ed-6c49-419d-833a-153881374aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.821117 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4037ed-6c49-419d-833a-153881374aa1 None admin] PATH_INFO: `/v3/system/users/166cae82b4064723a13209f9314fb6ca/roles/4ff172ce2b424a9589c1730145dd135e` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.830438 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4037ed-6c49-419d-833a-153881374aa1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=166cae82b4064723a13209f9314fb6ca, role_id=4ff172ce2b424a9589c1730145dd135e)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:32.830438 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4037ed-6c49-419d-833a-153881374aa1 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.847118 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a75170-c50b-4a22-a581-23a5372b19b3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:32.883405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249e1f-0e70-4564-8039-5b0e414bd90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:32.884085 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249e1f-0e70-4564-8039-5b0e414bd90c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:32.884396 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249e1f-0e70-4564-8039-5b0e414bd90c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:32.884674 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249e1f-0e70-4564-8039-5b0e414bd90c None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:32.885392 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249e1f-0e70-4564-8039-5b0e414bd90c None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:32.885691 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249e1f-0e70-4564-8039-5b0e414bd90c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:32.887076 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249e1f-0e70-4564-8039-5b0e414bd90c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:32.897079 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 164/331] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:32 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:32.902445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249e1f-0e70-4564-8039-5b0e414bd90c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:32.957239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 168/332] 10.222.0.100 () {58 vars in 1339 bytes} [Tue Jul 26 15:11:32 2022] PUT /identity/v3/system/users/166cae82b4064723a13209f9314fb6ca/roles/4ff172ce2b424a9589c1730145dd135e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:11:32.977009 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:33.023501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249e1f-0e70-4564-8039-5b0e414bd90c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:33.065232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d6038-e4c8-43a2-8b84-e774d27de6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:33.066907 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d6038-e4c8-43a2-8b84-e774d27de6f0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:33.067384 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d6038-e4c8-43a2-8b84-e774d27de6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:33.067848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d6038-e4c8-43a2-8b84-e774d27de6f0 None admin] PATH_INFO: `/v3/users/a82429d16dcc4a5ab2a86a1f913c2e79` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:33.069327 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d6038-e4c8-43a2-8b84-e774d27de6f0 None admin] RBAC: Authorizing `identity:get_user(user_id=a82429d16dcc4a5ab2a86a1f913c2e79)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:33.071062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d6038-e4c8-43a2-8b84-e774d27de6f0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:33.073425 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 165/333] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:32 2022] GET /identity/v3/users/a82429d16dcc4a5ab2a86a1f913c2e79 => generated 294 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:33.079747 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4037ed-6c49-419d-833a-153881374aa1 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:33.214047 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:33.224587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4037ed-6c49-419d-833a-153881374aa1 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:33.270041 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70294309-0956-4426-aec2-38c6acdc55c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:33.270678 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294309-0956-4426-aec2-38c6acdc55c9 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:33.270962 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294309-0956-4426-aec2-38c6acdc55c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:33.271240 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70294309-0956-4426-aec2-38c6acdc55c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:33.272034 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70294309-0956-4426-aec2-38c6acdc55c9 None admin] RBAC: Adding query filter params (role.id=7b33619ed33f41c0b797124afa4a385d, user.id=a82429d16dcc4a5ab2a86a1f913c2e79, scope.system=all) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:33.272369 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70294309-0956-4426-aec2-38c6acdc55c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:33.273824 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70294309-0956-4426-aec2-38c6acdc55c9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:33.294166 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 169/334] 10.222.0.100 () {56 vars in 1313 bytes} [Tue Jul 26 15:11:33 2022] GET /identity/v3/role_assignments?user.id=a82429d16dcc4a5ab2a86a1f913c2e79&scope.system=all&role.id=7b33619ed33f41c0b797124afa4a385d => generated 512 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:35.627125 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e933a8-0b16-4839-a472-d09f2ab716f5 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:35.628306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e933a8-0b16-4839-a472-d09f2ab716f5 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:35.628832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e933a8-0b16-4839-a472-d09f2ab716f5 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:35.630675 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 166/335] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:35.636812 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257cd8f-b7ac-460c-a493-d9152b3052df None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:35.637652 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257cd8f-b7ac-460c-a493-d9152b3052df None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:35.638146 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257cd8f-b7ac-460c-a493-d9152b3052df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:35.658788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-1257cd8f-b7ac-460c-a493-d9152b3052df None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:35.660870 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-1257cd8f-b7ac-460c-a493-d9152b3052df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:35.663217 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c9b3c-23fb-4b15-8e21-9c68442e9779 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:35.663726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c9b3c-23fb-4b15-8e21-9c68442e9779 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:35.664322 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c9b3c-23fb-4b15-8e21-9c68442e9779 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:35.669551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 167/336] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:35 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:35.678569 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059a5d9-ee62-4616-9077-bc28bc491377 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:35.679133 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059a5d9-ee62-4616-9077-bc28bc491377 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:35.679604 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059a5d9-ee62-4616-9077-bc28bc491377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:35.700457 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-e059a5d9-ee62-4616-9077-bc28bc491377 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:35.701958 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e059a5d9-ee62-4616-9077-bc28bc491377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:35.780295 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 168/337] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:35.797693 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 170/338] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:35.805999 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f7b92-e623-41e4-ae19-e495d9b4697d None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:35.806288 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f7b92-e623-41e4-ae19-e495d9b4697d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:35.806569 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f7b92-e623-41e4-ae19-e495d9b4697d None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:35.808187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 169/339] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:35.814191 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2d45-1bbe-4d31-8c47-2b7dfa5cfd7c None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:35.814481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2d45-1bbe-4d31-8c47-2b7dfa5cfd7c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:35.814760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2d45-1bbe-4d31-8c47-2b7dfa5cfd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:35.826505 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f7b92-e623-41e4-ae19-e495d9b4697d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:35.847685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-f6bb2d45-1bbe-4d31-8c47-2b7dfa5cfd7c None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:35.848935 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f6bb2d45-1bbe-4d31-8c47-2b7dfa5cfd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:35.931383 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:35.965768 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 171/340] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:35.969285 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2d45-1bbe-4d31-8c47-2b7dfa5cfd7c None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:35.992139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:35.995062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f7b92-e623-41e4-ae19-e495d9b4697d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:36.070135 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eb26b-ab81-4c4e-adee-04c7021c55e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:36.070810 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb26b-ab81-4c4e-adee-04c7021c55e7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.071099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb26b-ab81-4c4e-adee-04c7021c55e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.071375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb26b-ab81-4c4e-adee-04c7021c55e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.092071 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eb26b-ab81-4c4e-adee-04c7021c55e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-742eb26b-ab81-4c4e-adee-04c7021c55e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:36.098619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:36.099641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 15:11:36.100541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:36.103223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2d45-1bbe-4d31-8c47-2b7dfa5cfd7c None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:36.104704 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 170/341] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:36.105885 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eb26b-ab81-4c4e-adee-04c7021c55e7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:36.143475 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cd693-b094-4d04-97d0-54c160b1400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:36.144199 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cd693-b094-4d04-97d0-54c160b1400c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.144487 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cd693-b094-4d04-97d0-54c160b1400c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.144763 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cd693-b094-4d04-97d0-54c160b1400c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.155901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cd693-b094-4d04-97d0-54c160b1400c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-330cd693-b094-4d04-97d0-54c160b1400c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:36.161569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:36.162456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 172/342] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:36.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cd693-b094-4d04-97d0-54c160b1400c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:36.242494 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:36.291814 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cd693-b094-4d04-97d0-54c160b1400c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:36.313038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eb26b-ab81-4c4e-adee-04c7021c55e7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:36.344057 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e6502-4f40-4420-b5a0-cd5815907e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:36.345462 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:36.346586 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e6502-4f40-4420-b5a0-cd5815907e23 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.347554 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e6502-4f40-4420-b5a0-cd5815907e23 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.348294 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e6502-4f40-4420-b5a0-cd5815907e23 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.349177 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e6502-4f40-4420-b5a0-cd5815907e23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:36.349758 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e6502-4f40-4420-b5a0-cd5815907e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:36.354442 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e6502-4f40-4420-b5a0-cd5815907e23 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:36.363376 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d10805-35e4-4499-af29-2b7afa0e5454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:36.364136 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10805-35e4-4499-af29-2b7afa0e5454 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.364495 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10805-35e4-4499-af29-2b7afa0e5454 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.364840 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10805-35e4-4499-af29-2b7afa0e5454 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.368387 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 173/343] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:36 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:36.369122 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e6502-4f40-4420-b5a0-cd5815907e23 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:36.379997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d10805-35e4-4499-af29-2b7afa0e5454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-48d10805-35e4-4499-af29-2b7afa0e5454 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:36.386103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:36.389654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:36.390625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:36.392835 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 171/344] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:36.396027 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4f55e-bb3c-4cb6-819c-bd64c7f6d725 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.397195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4f55e-bb3c-4cb6-819c-bd64c7f6d725 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.397477 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4f55e-bb3c-4cb6-819c-bd64c7f6d725 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.399889 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 172/345] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:36 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:36.405332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4f55e-bb3c-4cb6-819c-bd64c7f6d725 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:36.500303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e6502-4f40-4420-b5a0-cd5815907e23 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:36.514822 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4f55e-bb3c-4cb6-819c-bd64c7f6d725 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:36.533411 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:36.540269 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d2c32-0dc3-436a-8978-d7be92407aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:36.541182 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d2c32-0dc3-436a-8978-d7be92407aec None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.541919 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d2c32-0dc3-436a-8978-d7be92407aec None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.542430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d2c32-0dc3-436a-8978-d7be92407aec None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.543337 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d2c32-0dc3-436a-8978-d7be92407aec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:36.543835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d2c32-0dc3-436a-8978-d7be92407aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:36.545457 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d2c32-0dc3-436a-8978-d7be92407aec None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:36.555213 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ed3a-3d6b-4144-aae3-7f98d223f5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:36.555852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ed3a-3d6b-4144-aae3-7f98d223f5fb None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.556209 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ed3a-3d6b-4144-aae3-7f98d223f5fb None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.556482 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ed3a-3d6b-4144-aae3-7f98d223f5fb None admin] PATH_INFO: `/v3/users/166cae82b4064723a13209f9314fb6ca` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.556817 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 174/346] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:36 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:36.557890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d2c32-0dc3-436a-8978-d7be92407aec None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:36.562754 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ed3a-3d6b-4144-aae3-7f98d223f5fb None admin] RBAC: Authorizing `identity:get_user(user_id=166cae82b4064723a13209f9314fb6ca)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:36.563574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ed3a-3d6b-4144-aae3-7f98d223f5fb None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:36.565548 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 173/347] 10.222.0.100 () {56 vars in 1182 bytes} [Tue Jul 26 15:11:36 2022] GET /identity/v3/users/166cae82b4064723a13209f9314fb6ca => generated 294 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:36.567383 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea657d-fb43-481a-94f1-dddab78cf777 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.567659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea657d-fb43-481a-94f1-dddab78cf777 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.567928 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea657d-fb43-481a-94f1-dddab78cf777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.591460 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b3ea657d-fb43-481a-94f1-dddab78cf777 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:36.592673 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b3ea657d-fb43-481a-94f1-dddab78cf777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:36.640840 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:36.664892 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 174/348] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:36.671482 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d2c32-0dc3-436a-8978-d7be92407aec None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:36.672973 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea657d-fb43-481a-94f1-dddab78cf777 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:36.711899 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07799e5a-4fb6-4d2c-9a10-a8c8409fe4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:36.712844 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07799e5a-4fb6-4d2c-9a10-a8c8409fe4fe None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.713304 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07799e5a-4fb6-4d2c-9a10-a8c8409fe4fe None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.713761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07799e5a-4fb6-4d2c-9a10-a8c8409fe4fe None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.714684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07799e5a-4fb6-4d2c-9a10-a8c8409fe4fe None admin] RBAC: Adding query filter params (name=member) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:36.715165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07799e5a-4fb6-4d2c-9a10-a8c8409fe4fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:36.716843 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07799e5a-4fb6-4d2c-9a10-a8c8409fe4fe None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:36.727022 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 175/349] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:36 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:36.728228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07799e5a-4fb6-4d2c-9a10-a8c8409fe4fe None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:36.797457 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:36.806180 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea657d-fb43-481a-94f1-dddab78cf777 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:36.843824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e884c-0e5d-4985-bc64-a0d06e44fb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:36.844317 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e884c-0e5d-4985-bc64-a0d06e44fb85 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.844615 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e884c-0e5d-4985-bc64-a0d06e44fb85 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.845467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e884c-0e5d-4985-bc64-a0d06e44fb85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.849186 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07799e5a-4fb6-4d2c-9a10-a8c8409fe4fe None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:36.888728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be423-94a6-485f-a00c-8e73e0b17cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:36.889988 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be423-94a6-485f-a00c-8e73e0b17cca None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:36.890457 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be423-94a6-485f-a00c-8e73e0b17cca None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:36.890993 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be423-94a6-485f-a00c-8e73e0b17cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:36.894040 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be423-94a6-485f-a00c-8e73e0b17cca None admin] RBAC: Adding query filter params (role.id=4ff172ce2b424a9589c1730145dd135e, user.id=166cae82b4064723a13209f9314fb6ca, scope.system=all) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:36.894040 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be423-94a6-485f-a00c-8e73e0b17cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:36.894801 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:36.894909 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be423-94a6-485f-a00c-8e73e0b17cca None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:36.919831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e884c-0e5d-4985-bc64-a0d06e44fb85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:36.921619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e884c-0e5d-4985-bc64-a0d06e44fb85 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:36.922094 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 176/350] 10.222.0.100 () {56 vars in 1313 bytes} [Tue Jul 26 15:11:36 2022] GET /identity/v3/role_assignments?user.id=166cae82b4064723a13209f9314fb6ca&scope.system=all&role.id=4ff172ce2b424a9589c1730145dd135e => generated 512 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:36.923139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be423-94a6-485f-a00c-8e73e0b17cca None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:37.060651 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be423-94a6-485f-a00c-8e73e0b17cca None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:37.076061 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 175/351] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:37.076726 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:37.078588 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e884c-0e5d-4985-bc64-a0d06e44fb85 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:37.102137 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80bc850-0f52-4c8c-82b1-ccfa49879217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:37.102805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bc850-0f52-4c8c-82b1-ccfa49879217 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.103087 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bc850-0f52-4c8c-82b1-ccfa49879217 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.103363 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bc850-0f52-4c8c-82b1-ccfa49879217 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.116379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80bc850-0f52-4c8c-82b1-ccfa49879217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-c80bc850-0f52-4c8c-82b1-ccfa49879217 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:37.122918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:37.123879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:37.124923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:37.128413 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 177/352] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:37.129934 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409729-9267-45a5-8f61-0792610355c2 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.130221 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409729-9267-45a5-8f61-0792610355c2 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.130497 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf409729-9267-45a5-8f61-0792610355c2 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.131858 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 178/353] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:37.133001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf409729-9267-45a5-8f61-0792610355c2 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:37.177434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:37.204069 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e884c-0e5d-4985-bc64-a0d06e44fb85 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:37.259571 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c1622-503d-4b7b-a23b-704442e962b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:37.260631 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c1622-503d-4b7b-a23b-704442e962b0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.260913 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c1622-503d-4b7b-a23b-704442e962b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.261182 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c1622-503d-4b7b-a23b-704442e962b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.268423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf409729-9267-45a5-8f61-0792610355c2 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:37.313106 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3ea4-aae9-47e8-965e-2a0ed4b4e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:37.313762 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3ea4-aae9-47e8-965e-2a0ed4b4e6bd None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.314035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3ea4-aae9-47e8-965e-2a0ed4b4e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.314688 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3ea4-aae9-47e8-965e-2a0ed4b4e6bd None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.315573 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3ea4-aae9-47e8-965e-2a0ed4b4e6bd None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:37.317409 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3ea4-aae9-47e8-965e-2a0ed4b4e6bd None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:37.318754 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 179/354] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:37 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:37.319595 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3ea4-aae9-47e8-965e-2a0ed4b4e6bd None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:37.347684 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c1622-503d-4b7b-a23b-704442e962b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:37.349274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c1622-503d-4b7b-a23b-704442e962b0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:37.373557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:37.453693 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:37.457676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3ea4-aae9-47e8-965e-2a0ed4b4e6bd None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:37.488799 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 176/355] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:37.489647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afee5-fc7e-40f5-9f1b-e76ddeab5f93 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.489938 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afee5-fc7e-40f5-9f1b-e76ddeab5f93 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.490219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afee5-fc7e-40f5-9f1b-e76ddeab5f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.508253 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2982fd-831e-4f61-a1ac-ef28e639402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:37.509786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2982fd-831e-4f61-a1ac-ef28e639402b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.510149 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2982fd-831e-4f61-a1ac-ef28e639402b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.510499 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2982fd-831e-4f61-a1ac-ef28e639402b None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.511282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2982fd-831e-4f61-a1ac-ef28e639402b None admin] RBAC: Adding query filter params (name=member) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:37.511661 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2982fd-831e-4f61-a1ac-ef28e639402b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:37.512364 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c55afee5-fc7e-40f5-9f1b-e76ddeab5f93 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:37.513223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2982fd-831e-4f61-a1ac-ef28e639402b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:37.513988 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c55afee5-fc7e-40f5-9f1b-e76ddeab5f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:37.528163 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 180/356] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:37.528163 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2982fd-831e-4f61-a1ac-ef28e639402b None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:37.598514 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 177/357] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:37.599381 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55afee5-fc7e-40f5-9f1b-e76ddeab5f93 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:37.655512 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2982fd-831e-4f61-a1ac-ef28e639402b None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:37.660247 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:37.697407 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3746e3b-de28-43f6-a1e3-a7aa62dcabd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:37.698338 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3746e3b-de28-43f6-a1e3-a7aa62dcabd7 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.698907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3746e3b-de28-43f6-a1e3-a7aa62dcabd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.699366 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3746e3b-de28-43f6-a1e3-a7aa62dcabd7 None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.708883 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3746e3b-de28-43f6-a1e3-a7aa62dcabd7 None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:37.710288 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3746e3b-de28-43f6-a1e3-a7aa62dcabd7 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:37.711971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 181/358] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:37 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:37.712819 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3746e3b-de28-43f6-a1e3-a7aa62dcabd7 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:37.717519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55afee5-fc7e-40f5-9f1b-e76ddeab5f93 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:37.727736 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:37.765104 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251562-d3ec-4dae-9a1b-cb1e07ee8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:37.766255 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251562-d3ec-4dae-9a1b-cb1e07ee8057 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.766791 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251562-d3ec-4dae-9a1b-cb1e07ee8057 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.767051 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251562-d3ec-4dae-9a1b-cb1e07ee8057 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.768338 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb251562-d3ec-4dae-9a1b-cb1e07ee8057 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:37.770343 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb251562-d3ec-4dae-9a1b-cb1e07ee8057 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:37.772022 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 178/359] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:37 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:37.773241 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ae58f-3a99-4a69-894c-0e8e29fb21cb None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.773504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ae58f-3a99-4a69-894c-0e8e29fb21cb None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.773777 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ae58f-3a99-4a69-894c-0e8e29fb21cb None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.774982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 179/360] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:37 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:37.775679 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ae58f-3a99-4a69-894c-0e8e29fb21cb None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:37.845290 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3746e3b-de28-43f6-a1e3-a7aa62dcabd7 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:37.888217 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e054d-cc63-41f2-99a5-138a124e9fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:37.888798 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e054d-cc63-41f2-99a5-138a124e9fb4 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.889087 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e054d-cc63-41f2-99a5-138a124e9fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.889376 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e054d-cc63-41f2-99a5-138a124e9fb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.898976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ae58f-3a99-4a69-894c-0e8e29fb21cb None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:37.935196 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:37.938287 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a511893-6462-48ed-9e45-05353b480f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:37.938927 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511893-6462-48ed-9e45-05353b480f15 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:37.939204 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511893-6462-48ed-9e45-05353b480f15 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:37.939475 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511893-6462-48ed-9e45-05353b480f15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:37.952059 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a511893-6462-48ed-9e45-05353b480f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-6a511893-6462-48ed-9e45-05353b480f15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:37.960812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:37.961814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 180/361] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:37.962624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a511893-6462-48ed-9e45-05353b480f15 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:37.991316 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e054d-cc63-41f2-99a5-138a124e9fb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:37.992855 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e054d-cc63-41f2-99a5-138a124e9fb4 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:38.005147 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:38.087383 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a511893-6462-48ed-9e45-05353b480f15 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:38.116361 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 182/362] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:38.117229 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e054d-cc63-41f2-99a5-138a124e9fb4 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:38.130823 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b17a41-8456-4f88-b53b-4af95a8d9a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:38.134122 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b17a41-8456-4f88-b53b-4af95a8d9a18 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.134122 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b17a41-8456-4f88-b53b-4af95a8d9a18 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.134122 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b17a41-8456-4f88-b53b-4af95a8d9a18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.134122 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b17a41-8456-4f88-b53b-4af95a8d9a18 None admin] RBAC: Adding query filter params (group.id=0b99b23455a74561b47d478e5fd6696b, role.id=11db0567e2634cbb9e76b190bddd6e2a, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:38.134122 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b17a41-8456-4f88-b53b-4af95a8d9a18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:38.134716 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b17a41-8456-4f88-b53b-4af95a8d9a18 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:38.140747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 181/363] 10.222.0.100 () {56 vars in 1381 bytes} [Tue Jul 26 15:11:37 2022] GET /identity/v3/role_assignments?group.id=0b99b23455a74561b47d478e5fd6696b&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=11db0567e2634cbb9e76b190bddd6e2a => generated 261 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:38.144149 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9fdde-2f80-4c4d-81f6-34e5c32ad64f None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.144149 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9fdde-2f80-4c4d-81f6-34e5c32ad64f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.144149 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9fdde-2f80-4c4d-81f6-34e5c32ad64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.168532 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b5e9fdde-2f80-4c4d-81f6-34e5c32ad64f None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:38.171032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b5e9fdde-2f80-4c4d-81f6-34e5c32ad64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:38.228293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:38.283074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e054d-cc63-41f2-99a5-138a124e9fb4 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:38.292412 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 182/364] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:38.293702 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9fdde-2f80-4c4d-81f6-34e5c32ad64f None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:38.339421 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:38.343524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d530f-784d-40d8-8201-9f3004ef1377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:38.344557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d530f-784d-40d8-8201-9f3004ef1377 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.344838 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d530f-784d-40d8-8201-9f3004ef1377 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.345119 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d530f-784d-40d8-8201-9f3004ef1377 None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.347983 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d530f-784d-40d8-8201-9f3004ef1377 None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:38.349481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d530f-784d-40d8-8201-9f3004ef1377 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:38.351109 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 183/365] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:38 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:38.353899 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d530f-784d-40d8-8201-9f3004ef1377 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:38.448978 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9fdde-2f80-4c4d-81f6-34e5c32ad64f None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:38.482108 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d530f-784d-40d8-8201-9f3004ef1377 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:38.503905 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644e041-3e48-431c-9ef3-fde3d825a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:38.504935 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644e041-3e48-431c-9ef3-fde3d825a82b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.505416 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644e041-3e48-431c-9ef3-fde3d825a82b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.505890 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644e041-3e48-431c-9ef3-fde3d825a82b None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.506929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644e041-3e48-431c-9ef3-fde3d825a82b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:38.507432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644e041-3e48-431c-9ef3-fde3d825a82b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:38.509124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644e041-3e48-431c-9ef3-fde3d825a82b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:38.522008 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 183/366] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:38 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:38.523210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644e041-3e48-431c-9ef3-fde3d825a82b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:38.525324 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa59b5-ed1c-41bc-9a9e-3040d8668215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:38.525980 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa59b5-ed1c-41bc-9a9e-3040d8668215 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.526250 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa59b5-ed1c-41bc-9a9e-3040d8668215 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.526525 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa59b5-ed1c-41bc-9a9e-3040d8668215 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.528833 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa59b5-ed1c-41bc-9a9e-3040d8668215 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:38.530482 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa59b5-ed1c-41bc-9a9e-3040d8668215 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:38.532211 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 184/367] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:38 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:38.532983 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa59b5-ed1c-41bc-9a9e-3040d8668215 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:38.537697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:38.651357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:38.662306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644e041-3e48-431c-9ef3-fde3d825a82b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:38.676585 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa59b5-ed1c-41bc-9a9e-3040d8668215 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:38.704914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3739a6a-dd44-4ef8-a333-c30fb1a4546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:38.705901 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3739a6a-dd44-4ef8-a333-c30fb1a4546f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.706183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3739a6a-dd44-4ef8-a333-c30fb1a4546f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.706923 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3739a6a-dd44-4ef8-a333-c30fb1a4546f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.721478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3739a6a-dd44-4ef8-a333-c30fb1a4546f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f3739a6a-dd44-4ef8-a333-c30fb1a4546f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:38.727083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:38.727998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 184/368] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:38.729243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3739a6a-dd44-4ef8-a333-c30fb1a4546f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:38.732901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a760-d2a0-43be-8307-d365d81d555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:38.733606 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a760-d2a0-43be-8307-d365d81d555d None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.733853 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a760-d2a0-43be-8307-d365d81d555d None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.734128 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a760-d2a0-43be-8307-d365d81d555d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.734922 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6a760-d2a0-43be-8307-d365d81d555d None admin] RBAC: Adding query filter params (group.id=0b99b23455a74561b47d478e5fd6696b, role.id=7b33619ed33f41c0b797124afa4a385d, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:38.735228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6a760-d2a0-43be-8307-d365d81d555d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:38.736706 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6a760-d2a0-43be-8307-d365d81d555d None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:38.744752 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 185/369] 10.222.0.100 () {56 vars in 1381 bytes} [Tue Jul 26 15:11:38 2022] GET /identity/v3/role_assignments?group.id=0b99b23455a74561b47d478e5fd6696b&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=7b33619ed33f41c0b797124afa4a385d => generated 261 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:38.745578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a760-d2a0-43be-8307-d365d81d555d None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:38.837708 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:38.847868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3739a6a-dd44-4ef8-a333-c30fb1a4546f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:38.868084 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a760-d2a0-43be-8307-d365d81d555d None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:38.890085 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232083b-cce2-48e3-8107-6b3ee2546f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:38.891102 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232083b-cce2-48e3-8107-6b3ee2546f21 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.891614 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232083b-cce2-48e3-8107-6b3ee2546f21 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.892091 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232083b-cce2-48e3-8107-6b3ee2546f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.908869 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53a392-b30e-4fa7-97ae-48d9796402b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:38.909664 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53a392-b30e-4fa7-97ae-48d9796402b6 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:38.909955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53a392-b30e-4fa7-97ae-48d9796402b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:38.910234 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53a392-b30e-4fa7-97ae-48d9796402b6 None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:38.912070 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53a392-b30e-4fa7-97ae-48d9796402b6 None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:38.913621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53a392-b30e-4fa7-97ae-48d9796402b6 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:38.915837 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 186/370] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:38 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:38.916933 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53a392-b30e-4fa7-97ae-48d9796402b6 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:38.919616 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:38.979610 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232083b-cce2-48e3-8107-6b3ee2546f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:38.981399 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232083b-cce2-48e3-8107-6b3ee2546f21 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.048659 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53a392-b30e-4fa7-97ae-48d9796402b6 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.100104 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c96a5-e91b-4be3-9c4e-7c45429813a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.100774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c96a5-e91b-4be3-9c4e-7c45429813a1 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.101057 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c96a5-e91b-4be3-9c4e-7c45429813a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.101335 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c96a5-e91b-4be3-9c4e-7c45429813a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.102050 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c96a5-e91b-4be3-9c4e-7c45429813a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:39.102359 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c96a5-e91b-4be3-9c4e-7c45429813a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.103741 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c96a5-e91b-4be3-9c4e-7c45429813a1 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.106276 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:39.115349 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 187/371] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:38 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:39.115794 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c96a5-e91b-4be3-9c4e-7c45429813a1 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.122340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 185/372] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:39.122340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232083b-cce2-48e3-8107-6b3ee2546f21 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.180532 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:39.225311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c96a5-e91b-4be3-9c4e-7c45429813a1 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.230157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232083b-cce2-48e3-8107-6b3ee2546f21 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.263279 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcc416-b094-4561-9e51-1af243ebafce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.264400 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcc416-b094-4561-9e51-1af243ebafce None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.265032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcc416-b094-4561-9e51-1af243ebafce None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.265599 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcc416-b094-4561-9e51-1af243ebafce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.266764 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcc416-b094-4561-9e51-1af243ebafce None admin] RBAC: Adding query filter params (group.id=0b99b23455a74561b47d478e5fd6696b, role.id=7b33619ed33f41c0b797124afa4a385d, scope.project.id=ee63142a18be4b4e894b8d8097311a63) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:39.267311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcc416-b094-4561-9e51-1af243ebafce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.267750 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed9382-c23d-486d-a129-c6a941b7716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.268403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9382-c23d-486d-a129-c6a941b7716e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.268686 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9382-c23d-486d-a129-c6a941b7716e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.269092 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9382-c23d-486d-a129-c6a941b7716e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.270002 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcc416-b094-4561-9e51-1af243ebafce None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.276195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 188/373] 10.222.0.100 () {56 vars in 1381 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/role_assignments?group.id=0b99b23455a74561b47d478e5fd6696b&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=7b33619ed33f41c0b797124afa4a385d => generated 261 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:39.277261 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcc416-b094-4561-9e51-1af243ebafce None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.345901 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed9382-c23d-486d-a129-c6a941b7716e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.347904 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed9382-c23d-486d-a129-c6a941b7716e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.350400 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:39.396006 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcc416-b094-4561-9e51-1af243ebafce None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.404492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:39.436200 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393946a-66de-43b5-8220-e71af2cd659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.437229 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393946a-66de-43b5-8220-e71af2cd659c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.437741 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393946a-66de-43b5-8220-e71af2cd659c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.438216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393946a-66de-43b5-8220-e71af2cd659c None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.439937 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393946a-66de-43b5-8220-e71af2cd659c None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.441718 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393946a-66de-43b5-8220-e71af2cd659c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.443716 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 189/374] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:39.449307 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393946a-66de-43b5-8220-e71af2cd659c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.460314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 186/375] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:39.468413 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed9382-c23d-486d-a129-c6a941b7716e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.638328 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed9382-c23d-486d-a129-c6a941b7716e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.664129 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393946a-66de-43b5-8220-e71af2cd659c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.678933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6fd2d-06ff-4bd5-a3e0-664d265c8e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.679582 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6fd2d-06ff-4bd5-a3e0-664d265c8e33 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.679860 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6fd2d-06ff-4bd5-a3e0-664d265c8e33 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.680153 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6fd2d-06ff-4bd5-a3e0-664d265c8e33 None admin] PATH_INFO: `/v3/projects/bca50b89fb044b68b53520d35aa1aa1b` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.682409 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6fd2d-06ff-4bd5-a3e0-664d265c8e33 None admin] RBAC: Authorizing `identity:get_project(project_id=bca50b89fb044b68b53520d35aa1aa1b)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.683851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6fd2d-06ff-4bd5-a3e0-664d265c8e33 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.685553 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 187/376] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/projects/bca50b89fb044b68b53520d35aa1aa1b => generated 345 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:39.692360 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6fd2d-06ff-4bd5-a3e0-664d265c8e33 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.720495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:39.731135 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a4d1a-bed1-4d37-9e15-849e625d9e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.731857 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4d1a-bed1-4d37-9e15-849e625d9e0e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.732155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4d1a-bed1-4d37-9e15-849e625d9e0e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.732444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4d1a-bed1-4d37-9e15-849e625d9e0e None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.736594 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:39.737033 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a4d1a-bed1-4d37-9e15-849e625d9e0e None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.738500 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a4d1a-bed1-4d37-9e15-849e625d9e0e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.740783 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 190/377] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:39.746545 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a4d1a-bed1-4d37-9e15-849e625d9e0e None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:39.854335 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6fd2d-06ff-4bd5-a3e0-664d265c8e33 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.939465 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a4d1a-bed1-4d37-9e15-849e625d9e0e None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:39.939651 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12b380-c916-4c91-8492-5a32ac346c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:39.940135 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b380-c916-4c91-8492-5a32ac346c97 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:39.940426 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b380-c916-4c91-8492-5a32ac346c97 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:39.940737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b380-c916-4c91-8492-5a32ac346c97 None admin] PATH_INFO: `/v3/groups/77e4f394382b4b02958c8de474234de7` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:39.957317 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12b380-c916-4c91-8492-5a32ac346c97 None admin] RBAC: Authorizing `identity:get_group(group_id=77e4f394382b4b02958c8de474234de7)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:39.958793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12b380-c916-4c91-8492-5a32ac346c97 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:39.963558 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 188/378] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/groups/77e4f394382b4b02958c8de474234de7 => generated 230 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:39.966629 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12b380-c916-4c91-8492-5a32ac346c97 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:40.000245 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889421a-3908-4a0b-94dc-644a8f204c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:40.002054 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889421a-3908-4a0b-94dc-644a8f204c97 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:40.002671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889421a-3908-4a0b-94dc-644a8f204c97 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:40.002956 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889421a-3908-4a0b-94dc-644a8f204c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:40.005578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889421a-3908-4a0b-94dc-644a8f204c97 None admin] RBAC: Adding query filter params (group.id=0b99b23455a74561b47d478e5fd6696b, role.id=11db0567e2634cbb9e76b190bddd6e2a, scope.project.id=ee63142a18be4b4e894b8d8097311a63) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:40.005959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889421a-3908-4a0b-94dc-644a8f204c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:40.009558 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889421a-3908-4a0b-94dc-644a8f204c97 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:40.020674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 191/379] 10.222.0.100 () {56 vars in 1381 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/role_assignments?group.id=0b99b23455a74561b47d478e5fd6696b&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=11db0567e2634cbb9e76b190bddd6e2a => generated 261 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:40.087598 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:40.105373 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12b380-c916-4c91-8492-5a32ac346c97 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:40.158194 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830df76-2a76-40a5-92bd-b3cbb9addd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:40.159190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830df76-2a76-40a5-92bd-b3cbb9addd61 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:40.160218 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830df76-2a76-40a5-92bd-b3cbb9addd61 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:40.160784 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830df76-2a76-40a5-92bd-b3cbb9addd61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:40.161773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830df76-2a76-40a5-92bd-b3cbb9addd61 None admin] RBAC: Adding query filter params (group.id=77e4f394382b4b02958c8de474234de7, role.id=6d23401ca57e47398bf036ea320a7617, scope.project.id=bca50b89fb044b68b53520d35aa1aa1b) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:40.162274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830df76-2a76-40a5-92bd-b3cbb9addd61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:40.163970 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830df76-2a76-40a5-92bd-b3cbb9addd61 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:40.174318 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 189/380] 10.222.0.100 () {56 vars in 1381 bytes} [Tue Jul 26 15:11:39 2022] GET /identity/v3/role_assignments?group.id=77e4f394382b4b02958c8de474234de7&scope.project.id=bca50b89fb044b68b53520d35aa1aa1b&role.id=6d23401ca57e47398bf036ea320a7617 => generated 261 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:40.844057 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4133a-d817-452e-b988-b967356f4c32 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:40.844564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4133a-d817-452e-b988-b967356f4c32 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:40.844564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4133a-d817-452e-b988-b967356f4c32 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:40.846040 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 192/381] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:40.852774 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adfa43-1710-4c52-b58f-41bc30a99d36 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:40.853677 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adfa43-1710-4c52-b58f-41bc30a99d36 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:40.854147 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adfa43-1710-4c52-b58f-41bc30a99d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:40.876654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-a6adfa43-1710-4c52-b58f-41bc30a99d36 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:40.878253 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-a6adfa43-1710-4c52-b58f-41bc30a99d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:40.971067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 190/382] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:41.007951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4133a-d817-452e-b988-b967356f4c32 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:41.089286 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:41.140774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4133a-d817-452e-b988-b967356f4c32 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:41.182023 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521da248-2dcd-43e5-a538-e754c7cc3e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:41.183047 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521da248-2dcd-43e5-a538-e754c7cc3e20 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:41.183531 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521da248-2dcd-43e5-a538-e754c7cc3e20 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:41.188169 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521da248-2dcd-43e5-a538-e754c7cc3e20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:41.204282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521da248-2dcd-43e5-a538-e754c7cc3e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-521da248-2dcd-43e5-a538-e754c7cc3e20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:41.210835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:41.211889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:41.212725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:41.221193 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 193/383] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:41.227231 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adfa43-1710-4c52-b58f-41bc30a99d36 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:41.331826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:41.356807 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adfa43-1710-4c52-b58f-41bc30a99d36 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:41.399641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff8a2a-b575-4067-a0a7-7aa79c2dddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:41.400209 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff8a2a-b575-4067-a0a7-7aa79c2dddc6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:41.400499 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff8a2a-b575-4067-a0a7-7aa79c2dddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:41.400777 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff8a2a-b575-4067-a0a7-7aa79c2dddc6 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:41.401500 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff8a2a-b575-4067-a0a7-7aa79c2dddc6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:41.401805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff8a2a-b575-4067-a0a7-7aa79c2dddc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:41.403194 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff8a2a-b575-4067-a0a7-7aa79c2dddc6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:41.415867 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 191/384] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:41 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:41.421309 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521da248-2dcd-43e5-a538-e754c7cc3e20 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:41.600797 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521da248-2dcd-43e5-a538-e754c7cc3e20 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:41.624256 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:41.628909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb924d-fa6a-4df0-a4b7-5766be248d09 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:41.629201 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb924d-fa6a-4df0-a4b7-5766be248d09 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:41.629485 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb924d-fa6a-4df0-a4b7-5766be248d09 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:41.631107 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 192/385] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:41.636000 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b81c-b3ac-44c5-bc55-5735a2dc1cda None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:41.636317 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b81c-b3ac-44c5-bc55-5735a2dc1cda None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:41.636593 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549b81c-b3ac-44c5-bc55-5735a2dc1cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:41.637427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe97dd-1f78-43a5-833d-865de5b9f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:41.638079 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe97dd-1f78-43a5-833d-865de5b9f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:41.643574 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe97dd-1f78-43a5-833d-865de5b9f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:41.643574 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe97dd-1f78-43a5-833d-865de5b9f8c6 None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:41.643574 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe97dd-1f78-43a5-833d-865de5b9f8c6 None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:41.643574 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe97dd-1f78-43a5-833d-865de5b9f8c6 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:41.643574 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 194/386] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:41 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:41.651299 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe97dd-1f78-43a5-833d-865de5b9f8c6 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:41.684150 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-2549b81c-b3ac-44c5-bc55-5735a2dc1cda None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:41.685377 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-2549b81c-b3ac-44c5-bc55-5735a2dc1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:41.771346 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe97dd-1f78-43a5-833d-865de5b9f8c6 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:41.807722 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6146b-c2df-4b16-8c48-7585d9507d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:41.809840 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6146b-c2df-4b16-8c48-7585d9507d9c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:41.810450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6146b-c2df-4b16-8c48-7585d9507d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:41.812186 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6146b-c2df-4b16-8c48-7585d9507d9c None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:41.815128 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6146b-c2df-4b16-8c48-7585d9507d9c None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:41.818532 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6146b-c2df-4b16-8c48-7585d9507d9c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:41.821400 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 195/387] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:41 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:41.826105 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6146b-c2df-4b16-8c48-7585d9507d9c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:41.833826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 193/388] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:41.879849 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549b81c-b3ac-44c5-bc55-5735a2dc1cda None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:41.919824 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.002584 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6146b-c2df-4b16-8c48-7585d9507d9c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:42.012478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.046425 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549b81c-b3ac-44c5-bc55-5735a2dc1cda None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:42.087126 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af3f37-9930-4ebd-8b95-3997be2572d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:42.088103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3f37-9930-4ebd-8b95-3997be2572d9 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.088612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3f37-9930-4ebd-8b95-3997be2572d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.089105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3f37-9930-4ebd-8b95-3997be2572d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.096275 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f14a3-cc65-46db-a3a2-42b7174c22e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:42.097004 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f14a3-cc65-46db-a3a2-42b7174c22e2 None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.097294 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f14a3-cc65-46db-a3a2-42b7174c22e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.097569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f14a3-cc65-46db-a3a2-42b7174c22e2 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/groups/0b99b23455a74561b47d478e5fd6696b/roles/11db0567e2634cbb9e76b190bddd6e2a` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.101554 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af3f37-9930-4ebd-8b95-3997be2572d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:42.104907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f14a3-cc65-46db-a3a2-42b7174c22e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0c05ddb694f492bb5fecdd464e933c9, group_id=0b99b23455a74561b47d478e5fd6696b, role_id=11db0567e2634cbb9e76b190bddd6e2a)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:42.106376 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f14a3-cc65-46db-a3a2-42b7174c22e2 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-30af3f37-9930-4ebd-8b95-3997be2572d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:42.107139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:42.108013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:42.108948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:42.111751 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 194/389] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:42.117397 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af3f37-9930-4ebd-8b95-3997be2572d9 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:42.197552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 196/390] 10.222.0.100 () {58 vars in 1447 bytes} [Tue Jul 26 15:11:41 2022] PUT /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/groups/0b99b23455a74561b47d478e5fd6696b/roles/11db0567e2634cbb9e76b190bddd6e2a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:42.247391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af3f37-9930-4ebd-8b95-3997be2572d9 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:42.297732 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.307162 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9de75-92f9-4aba-b1fd-33025387e2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:42.307804 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9de75-92f9-4aba-b1fd-33025387e2ea None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.308156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9de75-92f9-4aba-b1fd-33025387e2ea None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.308442 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9de75-92f9-4aba-b1fd-33025387e2ea None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.309184 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9de75-92f9-4aba-b1fd-33025387e2ea None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:42.309506 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9de75-92f9-4aba-b1fd-33025387e2ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:42.310953 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9de75-92f9-4aba-b1fd-33025387e2ea None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:42.325183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 195/391] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:42.332011 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f14a3-cc65-46db-a3a2-42b7174c22e2 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:42.413875 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252c8c-cb72-40fc-aea4-bcb6980098a1 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.414242 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252c8c-cb72-40fc-aea4-bcb6980098a1 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.414468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252c8c-cb72-40fc-aea4-bcb6980098a1 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.415972 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 196/392] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:42.427310 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb232de-297f-4c41-8e84-46303f671850 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.427601 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb232de-297f-4c41-8e84-46303f671850 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.427867 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb232de-297f-4c41-8e84-46303f671850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.453767 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-3fb232de-297f-4c41-8e84-46303f671850 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:42.455356 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-3fb232de-297f-4c41-8e84-46303f671850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:42.491019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f14a3-cc65-46db-a3a2-42b7174c22e2 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:42.514187 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.535850 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae52d-6987-4f8c-9e4d-e30707948f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:42.536700 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae52d-6987-4f8c-9e4d-e30707948f0b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.536875 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae52d-6987-4f8c-9e4d-e30707948f0b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.537236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae52d-6987-4f8c-9e4d-e30707948f0b None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.537441 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 197/393] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:42.544155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eae52d-6987-4f8c-9e4d-e30707948f0b None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:42.544934 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eae52d-6987-4f8c-9e4d-e30707948f0b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:42.546820 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 197/394] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:42 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:42.554755 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb232de-297f-4c41-8e84-46303f671850 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:42.570001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae52d-6987-4f8c-9e4d-e30707948f0b None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:42.694096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae52d-6987-4f8c-9e4d-e30707948f0b None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:42.732164 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fd21c-edf6-4645-9109-f37505068747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:42.732890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fd21c-edf6-4645-9109-f37505068747 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.733246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fd21c-edf6-4645-9109-f37505068747 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.733634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fd21c-edf6-4645-9109-f37505068747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.745584 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fd21c-edf6-4645-9109-f37505068747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-2b4fd21c-edf6-4645-9109-f37505068747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:42.751170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:42.752062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:42.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 198/395] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:42.759276 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fd21c-edf6-4645-9109-f37505068747 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:42.820373 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb232de-297f-4c41-8e84-46303f671850 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:42.832559 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.849875 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.867701 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13b2b7-ea02-4a79-9851-cdf4eda6d1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:42.869023 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13b2b7-ea02-4a79-9851-cdf4eda6d1a6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.869538 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13b2b7-ea02-4a79-9851-cdf4eda6d1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.870177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13b2b7-ea02-4a79-9851-cdf4eda6d1a6 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.872243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13b2b7-ea02-4a79-9851-cdf4eda6d1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:42.874359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13b2b7-ea02-4a79-9851-cdf4eda6d1a6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:42.876579 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 198/396] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:42 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:42.878571 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9bdd3-4c1c-45b0-a436-e2449ce28949 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.879091 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9bdd3-4c1c-45b0-a436-e2449ce28949 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.879595 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9bdd3-4c1c-45b0-a436-e2449ce28949 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.881611 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 199/397] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:42.884482 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9bdd3-4c1c-45b0-a436-e2449ce28949 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:42.897003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fd21c-edf6-4645-9109-f37505068747 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:42.940028 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9e473-4daf-4a0b-9be9-68711f5f8bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:42.942048 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e473-4daf-4a0b-9be9-68711f5f8bae None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.942597 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e473-4daf-4a0b-9be9-68711f5f8bae None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.943074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9e473-4daf-4a0b-9be9-68711f5f8bae None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.944001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9e473-4daf-4a0b-9be9-68711f5f8bae None admin] RBAC: Adding query filter params (name=member) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:42.944545 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9e473-4daf-4a0b-9be9-68711f5f8bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:42.946870 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9e473-4daf-4a0b-9be9-68711f5f8bae None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:42.971793 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 199/398] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:42.971793 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720ef6-c4de-4da1-91a9-e5af33fabe46 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:42.971793 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720ef6-c4de-4da1-91a9-e5af33fabe46 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:42.971793 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720ef6-c4de-4da1-91a9-e5af33fabe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:42.993342 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-c5720ef6-c4de-4da1-91a9-e5af33fabe46 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:42.994637 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-c5720ef6-c4de-4da1-91a9-e5af33fabe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:43.035585 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9bdd3-4c1c-45b0-a436-e2449ce28949 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:43.080149 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 200/399] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:43.080375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad27cf-5dd4-4f4f-9497-0bca5a5a5c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:43.080485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720ef6-c4de-4da1-91a9-e5af33fabe46 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:43.080570 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad27cf-5dd4-4f4f-9497-0bca5a5a5c3b None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.080570 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad27cf-5dd4-4f4f-9497-0bca5a5a5c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.080570 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad27cf-5dd4-4f4f-9497-0bca5a5a5c3b None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/groups/0b99b23455a74561b47d478e5fd6696b/roles/7b33619ed33f41c0b797124afa4a385d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.083084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad27cf-5dd4-4f4f-9497-0bca5a5a5c3b None admin] RBAC: Authorizing `identity:create_grant(project_id=b0c05ddb694f492bb5fecdd464e933c9, group_id=0b99b23455a74561b47d478e5fd6696b, role_id=7b33619ed33f41c0b797124afa4a385d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:43.084829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad27cf-5dd4-4f4f-9497-0bca5a5a5c3b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:43.122205 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:43.173163 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 200/400] 10.222.0.100 () {58 vars in 1447 bytes} [Tue Jul 26 15:11:42 2022] PUT /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9/groups/0b99b23455a74561b47d478e5fd6696b/roles/7b33619ed33f41c0b797124afa4a385d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:43.174571 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510f5d-3166-4685-93d2-b8e42b9542ea None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.175559 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510f5d-3166-4685-93d2-b8e42b9542ea None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.175856 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3510f5d-3166-4685-93d2-b8e42b9542ea None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.177447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 201/401] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:43.182739 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3510f5d-3166-4685-93d2-b8e42b9542ea None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:43.198531 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720ef6-c4de-4da1-91a9-e5af33fabe46 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:43.257483 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:43.257769 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1495566-8d57-46d8-82c3-8f4610764886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:43.258670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1495566-8d57-46d8-82c3-8f4610764886 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.259134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1495566-8d57-46d8-82c3-8f4610764886 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.259588 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1495566-8d57-46d8-82c3-8f4610764886 None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.262429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1495566-8d57-46d8-82c3-8f4610764886 None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:43.264769 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1495566-8d57-46d8-82c3-8f4610764886 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:43.272783 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 201/402] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:43 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:43.272783 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8da4-3313-4b03-8df7-9f82a65367b9 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.272783 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8da4-3313-4b03-8df7-9f82a65367b9 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.272783 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c8da4-3313-4b03-8df7-9f82a65367b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.296673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-5e0c8da4-3313-4b03-8df7-9f82a65367b9 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:43.298262 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-5e0c8da4-3313-4b03-8df7-9f82a65367b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:43.339157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3510f5d-3166-4685-93d2-b8e42b9542ea None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:43.379946 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f850-d93e-41cf-83cc-89994e952fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:43.380615 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f850-d93e-41cf-83cc-89994e952fc1 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.380892 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f850-d93e-41cf-83cc-89994e952fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.381163 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f850-d93e-41cf-83cc-89994e952fc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.391751 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 202/403] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:43.392839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f850-d93e-41cf-83cc-89994e952fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:43.392975 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c8da4-3313-4b03-8df7-9f82a65367b9 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-0890f850-d93e-41cf-83cc-89994e952fc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:43.398549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:43.399654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:43.400605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 202/404] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:43.406124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f850-d93e-41cf-83cc-89994e952fc1 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:43.439950 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:43.525367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f850-d93e-41cf-83cc-89994e952fc1 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:43.534163 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c8da4-3313-4b03-8df7-9f82a65367b9 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:43.537711 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:43.563294 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af75c-9fc4-4987-b056-13d59dfb041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:43.564410 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af75c-9fc4-4987-b056-13d59dfb041e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.564913 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af75c-9fc4-4987-b056-13d59dfb041e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.565445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af75c-9fc4-4987-b056-13d59dfb041e None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.566391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af75c-9fc4-4987-b056-13d59dfb041e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:43.566900 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af75c-9fc4-4987-b056-13d59dfb041e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:43.568532 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924af75c-9fc4-4987-b056-13d59dfb041e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:43.576457 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323518f-cc1e-4aa1-b0a6-ce89190912a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:43.577196 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323518f-cc1e-4aa1-b0a6-ce89190912a6 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.577479 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323518f-cc1e-4aa1-b0a6-ce89190912a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.577754 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323518f-cc1e-4aa1-b0a6-ce89190912a6 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.578956 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323518f-cc1e-4aa1-b0a6-ce89190912a6 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:43.580251 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 203/405] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:43 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:43.580453 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323518f-cc1e-4aa1-b0a6-ce89190912a6 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:43.581517 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af75c-9fc4-4987-b056-13d59dfb041e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:43.582535 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 203/406] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:43 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:43.588732 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323518f-cc1e-4aa1-b0a6-ce89190912a6 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:43.700414 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924af75c-9fc4-4987-b056-13d59dfb041e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:43.702107 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323518f-cc1e-4aa1-b0a6-ce89190912a6 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:43.704558 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:43.740792 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473dfbd-aa6e-439b-bffa-c10871df0a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:43.741892 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473dfbd-aa6e-439b-bffa-c10871df0a2b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.742434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473dfbd-aa6e-439b-bffa-c10871df0a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.742915 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473dfbd-aa6e-439b-bffa-c10871df0a2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.743921 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7037845-90d7-4386-a8c6-38eaf04b35a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:43.744628 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7037845-90d7-4386-a8c6-38eaf04b35a6 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.744910 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7037845-90d7-4386-a8c6-38eaf04b35a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.745184 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7037845-90d7-4386-a8c6-38eaf04b35a6 None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.746357 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7037845-90d7-4386-a8c6-38eaf04b35a6 None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:43.747792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7037845-90d7-4386-a8c6-38eaf04b35a6 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:43.754356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 204/407] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:43 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:43.755135 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7037845-90d7-4386-a8c6-38eaf04b35a6 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:43.756604 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473dfbd-aa6e-439b-bffa-c10871df0a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-8473dfbd-aa6e-439b-bffa-c10871df0a2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:43.761666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:43.764232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:43.765060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 204/408] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:43.766947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473dfbd-aa6e-439b-bffa-c10871df0a2b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:43.805876 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:43.869610 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7037845-90d7-4386-a8c6-38eaf04b35a6 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:43.879091 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473dfbd-aa6e-439b-bffa-c10871df0a2b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:43.913992 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149863b-62a9-42a9-876e-8bcf72a23608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:43.914885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149863b-62a9-42a9-876e-8bcf72a23608 None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.915222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149863b-62a9-42a9-876e-8bcf72a23608 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.915562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149863b-62a9-42a9-876e-8bcf72a23608 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63/groups/0b99b23455a74561b47d478e5fd6696b/roles/7b33619ed33f41c0b797124afa4a385d` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.917975 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149863b-62a9-42a9-876e-8bcf72a23608 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee63142a18be4b4e894b8d8097311a63, group_id=0b99b23455a74561b47d478e5fd6696b, role_id=7b33619ed33f41c0b797124afa4a385d)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:43.919427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149863b-62a9-42a9-876e-8bcf72a23608 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:43.922515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8af11-2a28-498a-8330-7ba952ef4f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:43.925432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8af11-2a28-498a-8330-7ba952ef4f61 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:43.925432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8af11-2a28-498a-8330-7ba952ef4f61 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:43.925432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8af11-2a28-498a-8330-7ba952ef4f61 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:43.926437 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8af11-2a28-498a-8330-7ba952ef4f61 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:43.927970 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8af11-2a28-498a-8330-7ba952ef4f61 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:43.934763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 205/409] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:43 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:43.934763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8af11-2a28-498a-8330-7ba952ef4f61 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:44.047639 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:44.052183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8af11-2a28-498a-8330-7ba952ef4f61 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:44.084887 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 205/410] 10.222.0.100 () {58 vars in 1447 bytes} [Tue Jul 26 15:11:43 2022] PUT /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63/groups/0b99b23455a74561b47d478e5fd6696b/roles/7b33619ed33f41c0b797124afa4a385d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:44.088511 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149863b-62a9-42a9-876e-8bcf72a23608 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:44.102757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b8182-0a50-42f9-a27e-cd73c8ef041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:44.102757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b8182-0a50-42f9-a27e-cd73c8ef041d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:44.102757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b8182-0a50-42f9-a27e-cd73c8ef041d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:44.102757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b8182-0a50-42f9-a27e-cd73c8ef041d None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:44.103178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b8182-0a50-42f9-a27e-cd73c8ef041d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:44.103178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b8182-0a50-42f9-a27e-cd73c8ef041d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:44.104031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b8182-0a50-42f9-a27e-cd73c8ef041d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:44.115099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 206/411] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:44.120651 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b8182-0a50-42f9-a27e-cd73c8ef041d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:44.141407 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:44.213979 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149863b-62a9-42a9-876e-8bcf72a23608 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:44.254560 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857ae4-f54e-42e6-aa37-6884d7889186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:44.255843 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857ae4-f54e-42e6-aa37-6884d7889186 None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:44.256533 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857ae4-f54e-42e6-aa37-6884d7889186 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:44.257008 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857ae4-f54e-42e6-aa37-6884d7889186 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63/groups/0b99b23455a74561b47d478e5fd6696b/roles/11db0567e2634cbb9e76b190bddd6e2a` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:44.264198 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14857ae4-f54e-42e6-aa37-6884d7889186 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee63142a18be4b4e894b8d8097311a63, group_id=0b99b23455a74561b47d478e5fd6696b, role_id=11db0567e2634cbb9e76b190bddd6e2a)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:44.267686 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14857ae4-f54e-42e6-aa37-6884d7889186 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:44.312355 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b8182-0a50-42f9-a27e-cd73c8ef041d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:44.341358 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 206/412] 10.222.0.100 () {58 vars in 1447 bytes} [Tue Jul 26 15:11:44 2022] PUT /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63/groups/0b99b23455a74561b47d478e5fd6696b/roles/11db0567e2634cbb9e76b190bddd6e2a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:44.359193 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697cfe2-9837-434a-8927-dfdd784cd5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:44.359910 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697cfe2-9837-434a-8927-dfdd784cd5e4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:44.360225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697cfe2-9837-434a-8927-dfdd784cd5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:44.360502 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697cfe2-9837-434a-8927-dfdd784cd5e4 None admin] PATH_INFO: `/v3/groups/77e4f394382b4b02958c8de474234de7` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:44.361758 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697cfe2-9837-434a-8927-dfdd784cd5e4 None admin] RBAC: Authorizing `identity:get_group(group_id=77e4f394382b4b02958c8de474234de7)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:44.363783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697cfe2-9837-434a-8927-dfdd784cd5e4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:44.368623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 207/413] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:44 2022] GET /identity/v3/groups/77e4f394382b4b02958c8de474234de7 => generated 230 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:44.371894 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857ae4-f54e-42e6-aa37-6884d7889186 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:44.507438 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:44.524692 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857ae4-f54e-42e6-aa37-6884d7889186 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:44.569957 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa500f1-6ba9-45ba-8ea7-ec720517876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:44.570594 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa500f1-6ba9-45ba-8ea7-ec720517876d None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:44.570876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa500f1-6ba9-45ba-8ea7-ec720517876d None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:44.571154 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa500f1-6ba9-45ba-8ea7-ec720517876d None admin] PATH_INFO: `/v3/projects/bca50b89fb044b68b53520d35aa1aa1b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:44.574389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa500f1-6ba9-45ba-8ea7-ec720517876d None admin] RBAC: Authorizing `identity:get_project(project_id=bca50b89fb044b68b53520d35aa1aa1b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:44.575898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa500f1-6ba9-45ba-8ea7-ec720517876d None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:44.577965 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 207/414] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:44 2022] GET /identity/v3/projects/bca50b89fb044b68b53520d35aa1aa1b => generated 345 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:44.584522 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697cfe2-9837-434a-8927-dfdd784cd5e4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:44.634920 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:44.661633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd760-f892-4d0d-a370-898c0a3b312d None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:44.661923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd760-f892-4d0d-a370-898c0a3b312d None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:44.662205 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cd760-f892-4d0d-a370-898c0a3b312d None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:44.665956 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 208/415] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:44 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:44.671743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0989467-a67f-44db-8e5d-08dc7cd779f5 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:44.672501 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0989467-a67f-44db-8e5d-08dc7cd779f5 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:44.673035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0989467-a67f-44db-8e5d-08dc7cd779f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:44.702214 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-c0989467-a67f-44db-8e5d-08dc7cd779f5 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:44.704052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-c0989467-a67f-44db-8e5d-08dc7cd779f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:44.728720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697cfe2-9837-434a-8927-dfdd784cd5e4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:44.774046 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c912e3-9bcf-4284-b308-a8df73142e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:44.775551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c912e3-9bcf-4284-b308-a8df73142e9f None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:44.775828 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c912e3-9bcf-4284-b308-a8df73142e9f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:44.776099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c912e3-9bcf-4284-b308-a8df73142e9f None admin] PATH_INFO: `/v3/projects/bca50b89fb044b68b53520d35aa1aa1b/groups/77e4f394382b4b02958c8de474234de7/roles/6d23401ca57e47398bf036ea320a7617` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:44.778991 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c912e3-9bcf-4284-b308-a8df73142e9f None admin] RBAC: Authorizing `identity:create_grant(project_id=bca50b89fb044b68b53520d35aa1aa1b, group_id=77e4f394382b4b02958c8de474234de7, role_id=6d23401ca57e47398bf036ea320a7617)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:44.783101 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c912e3-9bcf-4284-b308-a8df73142e9f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:44.808209 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 209/416] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:44.829970 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0989467-a67f-44db-8e5d-08dc7cd779f5 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:44.892431 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 208/417] 10.222.0.100 () {58 vars in 1447 bytes} [Tue Jul 26 15:11:44 2022] PUT /identity/v3/projects/bca50b89fb044b68b53520d35aa1aa1b/groups/77e4f394382b4b02958c8de474234de7/roles/6d23401ca57e47398bf036ea320a7617 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:11:44.947674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:44.957886 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0989467-a67f-44db-8e5d-08dc7cd779f5 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:45.011496 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2d47d-fdf5-4a08-8597-bce230f16017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:45.012214 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2d47d-fdf5-4a08-8597-bce230f16017 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:45.012535 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2d47d-fdf5-4a08-8597-bce230f16017 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:45.012813 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2d47d-fdf5-4a08-8597-bce230f16017 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:45.030434 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2d47d-fdf5-4a08-8597-bce230f16017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-19f2d47d-fdf5-4a08-8597-bce230f16017 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:45.035930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:45.036864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:45.037685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 210/418] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:45.043484 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c912e3-9bcf-4284-b308-a8df73142e9f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:45.187726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:45.198285 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c912e3-9bcf-4284-b308-a8df73142e9f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:45.241807 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dae8dd-748c-43da-a631-cac6a54d2b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:45.242434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dae8dd-748c-43da-a631-cac6a54d2b24 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:45.242712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dae8dd-748c-43da-a631-cac6a54d2b24 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:45.242982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dae8dd-748c-43da-a631-cac6a54d2b24 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:45.243747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dae8dd-748c-43da-a631-cac6a54d2b24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:45.244060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dae8dd-748c-43da-a631-cac6a54d2b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:45.245459 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dae8dd-748c-43da-a631-cac6a54d2b24 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:45.258019 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 209/419] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:45 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:45.262706 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2d47d-fdf5-4a08-8597-bce230f16017 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:45.405831 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2d47d-fdf5-4a08-8597-bce230f16017 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:45.451533 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79bf0-781f-4a9f-91d4-73083d038e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:45.452250 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79bf0-781f-4a9f-91d4-73083d038e7c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:45.452540 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79bf0-781f-4a9f-91d4-73083d038e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:45.452814 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79bf0-781f-4a9f-91d4-73083d038e7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:45.494912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:45.565975 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f79bf0-781f-4a9f-91d4-73083d038e7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:45.567554 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f79bf0-781f-4a9f-91d4-73083d038e7c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:45.684176 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 211/420] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:45 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:45.685661 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dae8dd-748c-43da-a631-cac6a54d2b24 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:45.793013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dae8dd-748c-43da-a631-cac6a54d2b24 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:45.839599 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb90a0-2a4f-41b2-8e9f-318a1fd46222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:45.840374 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb90a0-2a4f-41b2-8e9f-318a1fd46222 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:45.840657 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb90a0-2a4f-41b2-8e9f-318a1fd46222 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:45.840929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb90a0-2a4f-41b2-8e9f-318a1fd46222 None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:45.842299 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb90a0-2a4f-41b2-8e9f-318a1fd46222 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:45.843913 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb90a0-2a4f-41b2-8e9f-318a1fd46222 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:45.846022 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 210/421] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:45 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:45.852360 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79bf0-781f-4a9f-91d4-73083d038e7c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:45.919508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:45.978973 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79bf0-781f-4a9f-91d4-73083d038e7c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:46.030770 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111540eb-cf30-4116-b45e-50e702fb06d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:46.031421 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111540eb-cf30-4116-b45e-50e702fb06d3 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.031704 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111540eb-cf30-4116-b45e-50e702fb06d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.031981 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111540eb-cf30-4116-b45e-50e702fb06d3 None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.032507 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f18dd0-2967-409e-892b-26b550b87ea3 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.033014 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f18dd0-2967-409e-892b-26b550b87ea3 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.033424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111540eb-cf30-4116-b45e-50e702fb06d3 None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:46.033554 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f18dd0-2967-409e-892b-26b550b87ea3 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.035637 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 211/422] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:46 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:46.038457 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111540eb-cf30-4116-b45e-50e702fb06d3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:46.042309 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 212/423] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:45 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:46.043253 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525acd53-f31b-4a9a-9abb-3c3c3cc0a554 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.043479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525acd53-f31b-4a9a-9abb-3c3c3cc0a554 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.043749 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525acd53-f31b-4a9a-9abb-3c3c3cc0a554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.052683 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111540eb-cf30-4116-b45e-50e702fb06d3 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:46.077210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-525acd53-f31b-4a9a-9abb-3c3c3cc0a554 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:46.078392 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-525acd53-f31b-4a9a-9abb-3c3c3cc0a554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:46.110070 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:46.214968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111540eb-cf30-4116-b45e-50e702fb06d3 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:46.235643 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:46.253001 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 212/424] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:46.270306 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eefe61-f452-4c06-85e5-b8cbf5da0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:46.270940 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eefe61-f452-4c06-85e5-b8cbf5da0a3c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.271229 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eefe61-f452-4c06-85e5-b8cbf5da0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.271509 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eefe61-f452-4c06-85e5-b8cbf5da0a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.272427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eefe61-f452-4c06-85e5-b8cbf5da0a3c None admin] RBAC: Adding query filter params (group.id=0b99b23455a74561b47d478e5fd6696b, role.id=11db0567e2634cbb9e76b190bddd6e2a, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:46.272749 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eefe61-f452-4c06-85e5-b8cbf5da0a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:46.274262 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eefe61-f452-4c06-85e5-b8cbf5da0a3c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:46.280430 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525acd53-f31b-4a9a-9abb-3c3c3cc0a554 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:46.286609 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 213/425] 10.222.0.100 () {56 vars in 1381 bytes} [Tue Jul 26 15:11:46 2022] GET /identity/v3/role_assignments?group.id=0b99b23455a74561b47d478e5fd6696b&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=11db0567e2634cbb9e76b190bddd6e2a => generated 613 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:46.431311 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525acd53-f31b-4a9a-9abb-3c3c3cc0a554 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:46.483887 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04131fbf-6547-4272-a041-48b59f7dcf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:46.484993 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04131fbf-6547-4272-a041-48b59f7dcf27 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.485448 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04131fbf-6547-4272-a041-48b59f7dcf27 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.486037 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04131fbf-6547-4272-a041-48b59f7dcf27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.499342 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04131fbf-6547-4272-a041-48b59f7dcf27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-04131fbf-6547-4272-a041-48b59f7dcf27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:46.504316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:46.505262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:46.506120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 213/426] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:46.511815 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eefe61-f452-4c06-85e5-b8cbf5da0a3c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:46.633434 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eefe61-f452-4c06-85e5-b8cbf5da0a3c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:46.672423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf014c-9999-44b8-9067-66e0493c42e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:46.673058 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf014c-9999-44b8-9067-66e0493c42e5 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.673347 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf014c-9999-44b8-9067-66e0493c42e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.673644 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf014c-9999-44b8-9067-66e0493c42e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.674354 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf014c-9999-44b8-9067-66e0493c42e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:46.674670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf014c-9999-44b8-9067-66e0493c42e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:46.676063 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf014c-9999-44b8-9067-66e0493c42e5 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:46.685112 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 214/427] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:46 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:46.690827 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04131fbf-6547-4272-a041-48b59f7dcf27 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:46.714680 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:46.802657 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04131fbf-6547-4272-a041-48b59f7dcf27 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:46.839005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5ea53-f696-4a6a-a2cf-6499e308f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:46.839644 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ea53-f696-4a6a-a2cf-6499e308f98a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.839926 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ea53-f696-4a6a-a2cf-6499e308f98a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.840292 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ea53-f696-4a6a-a2cf-6499e308f98a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.883444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871fb5-118a-41f5-8844-2e493d960b42 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.883733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871fb5-118a-41f5-8844-2e493d960b42 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.884026 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871fb5-118a-41f5-8844-2e493d960b42 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.885826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 215/428] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:46.891532 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5978d-2213-441b-bc0f-7cef742911b6 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:46.891817 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5978d-2213-441b-bc0f-7cef742911b6 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:46.892097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5978d-2213-441b-bc0f-7cef742911b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:46.912464 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-9ba5978d-2213-441b-bc0f-7cef742911b6 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:46.913877 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-9ba5978d-2213-441b-bc0f-7cef742911b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:46.921973 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5ea53-f696-4a6a-a2cf-6499e308f98a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:46.923456 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5ea53-f696-4a6a-a2cf-6499e308f98a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:46.953599 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:46.958695 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:47.000178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 216/429] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:47.024193 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5978d-2213-441b-bc0f-7cef742911b6 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:47.035208 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 214/430] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:47.036430 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c2289-1658-4f3f-b63a-040684ae028d None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.036723 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c2289-1658-4f3f-b63a-040684ae028d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.037002 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c2289-1658-4f3f-b63a-040684ae028d None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.038561 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 215/431] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:47.040740 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c2289-1658-4f3f-b63a-040684ae028d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:47.141413 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5978d-2213-441b-bc0f-7cef742911b6 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:47.148130 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c2289-1658-4f3f-b63a-040684ae028d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:47.160651 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:47.179523 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de3be-0247-48fd-8099-03cbd366d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:47.180196 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de3be-0247-48fd-8099-03cbd366d5bd None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.180480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de3be-0247-48fd-8099-03cbd366d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.180781 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47de3be-0247-48fd-8099-03cbd366d5bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.184648 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfa572-dd29-4b5c-b331-7ffdc0b4073d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:47.185284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfa572-dd29-4b5c-b331-7ffdc0b4073d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.185578 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfa572-dd29-4b5c-b331-7ffdc0b4073d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.185852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfa572-dd29-4b5c-b331-7ffdc0b4073d None admin] PATH_INFO: `/v3/projects/b0c05ddb694f492bb5fecdd464e933c9` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.187350 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfa572-dd29-4b5c-b331-7ffdc0b4073d None admin] RBAC: Authorizing `identity:get_project(project_id=b0c05ddb694f492bb5fecdd464e933c9)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:47.188847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfa572-dd29-4b5c-b331-7ffdc0b4073d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:47.191049 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 216/432] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:47 2022] GET /identity/v3/projects/b0c05ddb694f492bb5fecdd464e933c9 => generated 299 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:47.192190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd845ad1-d6d6-4e73-9e03-feb9dfa1904b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.192477 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd845ad1-d6d6-4e73-9e03-feb9dfa1904b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.192751 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd845ad1-d6d6-4e73-9e03-feb9dfa1904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.194731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47de3be-0247-48fd-8099-03cbd366d5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-f47de3be-0247-48fd-8099-03cbd366d5bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:47.202508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:47.203456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 15:11:47.204341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:47.208154 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 217/433] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:47.208154 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de3be-0247-48fd-8099-03cbd366d5bd None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:47.215857 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-bd845ad1-d6d6-4e73-9e03-feb9dfa1904b None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:47.217806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-bd845ad1-d6d6-4e73-9e03-feb9dfa1904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:47.242889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:47.292166 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 217/434] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:47.292166 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd845ad1-d6d6-4e73-9e03-feb9dfa1904b None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:47.340542 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47de3be-0247-48fd-8099-03cbd366d5bd None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:47.383807 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4147ac0-2b63-4834-8112-399b72c5e4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:47.384802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4147ac0-2b63-4834-8112-399b72c5e4c3 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.385178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4147ac0-2b63-4834-8112-399b72c5e4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.385529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4147ac0-2b63-4834-8112-399b72c5e4c3 None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.386696 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4147ac0-2b63-4834-8112-399b72c5e4c3 None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:47.388193 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4147ac0-2b63-4834-8112-399b72c5e4c3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:47.395001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 218/435] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:47 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:47.395001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4147ac0-2b63-4834-8112-399b72c5e4c3 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:47.412635 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd845ad1-d6d6-4e73-9e03-feb9dfa1904b None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:47.422412 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:47.450669 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce772b7f-c90a-49b3-8147-9579c7989f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:47.451321 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce772b7f-c90a-49b3-8147-9579c7989f81 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.451615 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce772b7f-c90a-49b3-8147-9579c7989f81 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.452310 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce772b7f-c90a-49b3-8147-9579c7989f81 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.453284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce772b7f-c90a-49b3-8147-9579c7989f81 None admin] RBAC: Adding query filter params (name=member) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:47.454012 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce772b7f-c90a-49b3-8147-9579c7989f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:47.455448 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce772b7f-c90a-49b3-8147-9579c7989f81 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:47.464254 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 218/436] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:11:47 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:47.465064 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce772b7f-c90a-49b3-8147-9579c7989f81 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:47.516717 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4147ac0-2b63-4834-8112-399b72c5e4c3 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:47.518343 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:47.553696 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ef5fc-2de4-4cf7-8432-559a891dbdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:47.554453 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef5fc-2de4-4cf7-8432-559a891dbdc7 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.554792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef5fc-2de4-4cf7-8432-559a891dbdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.555070 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef5fc-2de4-4cf7-8432-559a891dbdc7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.565402 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ef5fc-2de4-4cf7-8432-559a891dbdc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-ea5ef5fc-2de4-4cf7-8432-559a891dbdc7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:47.570786 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:47.571744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:47.572580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 219/437] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:11:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:47.573300 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ef5fc-2de4-4cf7-8432-559a891dbdc7 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:47.580086 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce772b7f-c90a-49b3-8147-9579c7989f81 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:47.615921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45c69-9527-4cf3-8d9f-e257e531ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:47.616574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45c69-9527-4cf3-8d9f-e257e531ad70 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.616887 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45c69-9527-4cf3-8d9f-e257e531ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.617169 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc45c69-9527-4cf3-8d9f-e257e531ad70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.617994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc45c69-9527-4cf3-8d9f-e257e531ad70 None admin] RBAC: Adding query filter params (group.id=0b99b23455a74561b47d478e5fd6696b, role.id=7b33619ed33f41c0b797124afa4a385d, scope.project.id=b0c05ddb694f492bb5fecdd464e933c9) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:47.618303 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc45c69-9527-4cf3-8d9f-e257e531ad70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:47.619745 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc45c69-9527-4cf3-8d9f-e257e531ad70 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:47.626109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 219/438] 10.222.0.100 () {56 vars in 1381 bytes} [Tue Jul 26 15:11:47 2022] GET /identity/v3/role_assignments?group.id=0b99b23455a74561b47d478e5fd6696b&scope.project.id=b0c05ddb694f492bb5fecdd464e933c9&role.id=7b33619ed33f41c0b797124afa4a385d => generated 613 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:47.633818 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45c69-9527-4cf3-8d9f-e257e531ad70 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:47.695367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:47.710179 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ef5fc-2de4-4cf7-8432-559a891dbdc7 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:47.745636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe191937-5a4a-4069-b8b3-34d5fe935100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:47.751930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe191937-5a4a-4069-b8b3-34d5fe935100 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.752564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe191937-5a4a-4069-b8b3-34d5fe935100 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.753369 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe191937-5a4a-4069-b8b3-34d5fe935100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.778777 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc45c69-9527-4cf3-8d9f-e257e531ad70 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:47.802959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:47.821734 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b8741-ab78-4d76-be69-6a4c60914df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:47.822544 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b8741-ab78-4d76-be69-6a4c60914df0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.822924 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b8741-ab78-4d76-be69-6a4c60914df0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.823317 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b8741-ab78-4d76-be69-6a4c60914df0 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.824239 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b8741-ab78-4d76-be69-6a4c60914df0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:47.824651 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b8741-ab78-4d76-be69-6a4c60914df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:47.826248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b8741-ab78-4d76-be69-6a4c60914df0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:47.837084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 220/439] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:47 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:47.843310 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b8741-ab78-4d76-be69-6a4c60914df0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:47.858333 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe191937-5a4a-4069-b8b3-34d5fe935100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:47.859828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe191937-5a4a-4069-b8b3-34d5fe935100 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:47.969828 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:47.978174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b8741-ab78-4d76-be69-6a4c60914df0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:47.990934 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 220/440] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:47.997684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b078e5-5663-41dd-b083-20a1c3d5352f None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:47.997976 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b078e5-5663-41dd-b083-20a1c3d5352f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:47.998303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b078e5-5663-41dd-b083-20a1c3d5352f None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:47.999822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 221/441] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:48.002330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b078e5-5663-41dd-b083-20a1c3d5352f None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:48.027689 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa734135-0550-41c8-b7bc-48347730dd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:48.028349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa734135-0550-41c8-b7bc-48347730dd07 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.028636 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa734135-0550-41c8-b7bc-48347730dd07 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.028909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa734135-0550-41c8-b7bc-48347730dd07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:48.091632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:48.124188 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa734135-0550-41c8-b7bc-48347730dd07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:48.125884 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa734135-0550-41c8-b7bc-48347730dd07 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:48.136634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b078e5-5663-41dd-b083-20a1c3d5352f None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:48.180524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eade2d-d38e-4d50-a769-03fc22c8fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:48.181179 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eade2d-d38e-4d50-a769-03fc22c8fc8f None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.181488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eade2d-d38e-4d50-a769-03fc22c8fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.181733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eade2d-d38e-4d50-a769-03fc22c8fc8f None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:48.183631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eade2d-d38e-4d50-a769-03fc22c8fc8f None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:48.185118 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eade2d-d38e-4d50-a769-03fc22c8fc8f None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:48.186858 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 222/442] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:47 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:48.188074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a411694-921b-4fdb-8108-eff0a0ad9c0b None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.188451 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a411694-921b-4fdb-8108-eff0a0ad9c0b None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.188732 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a411694-921b-4fdb-8108-eff0a0ad9c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:48.208541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-8a411694-921b-4fdb-8108-eff0a0ad9c0b None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:48.209755 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-8a411694-921b-4fdb-8108-eff0a0ad9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:48.242071 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:48.249438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 221/443] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:48.250498 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa734135-0550-41c8-b7bc-48347730dd07 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:48.292144 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 223/444] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:48.292999 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a411694-921b-4fdb-8108-eff0a0ad9c0b None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:48.358764 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:48.367119 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa734135-0550-41c8-b7bc-48347730dd07 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:48.405396 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853f64e-2d6f-48dc-b78d-593c08c8247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:48.406045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853f64e-2d6f-48dc-b78d-593c08c8247b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.408751 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853f64e-2d6f-48dc-b78d-593c08c8247b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.408751 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853f64e-2d6f-48dc-b78d-593c08c8247b None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:48.408980 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a411694-921b-4fdb-8108-eff0a0ad9c0b None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:48.409075 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853f64e-2d6f-48dc-b78d-593c08c8247b None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:48.409703 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853f64e-2d6f-48dc-b78d-593c08c8247b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:48.411318 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 222/445] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:48 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:48.412134 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853f64e-2d6f-48dc-b78d-593c08c8247b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:48.445519 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b716-ab12-4f7e-b921-34dc502a5160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:48.446165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b716-ab12-4f7e-b921-34dc502a5160 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.446447 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b716-ab12-4f7e-b921-34dc502a5160 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.446721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b716-ab12-4f7e-b921-34dc502a5160 None admin] PATH_INFO: `/v3/projects/ee63142a18be4b4e894b8d8097311a63` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:48.447871 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580b716-ab12-4f7e-b921-34dc502a5160 None admin] RBAC: Authorizing `identity:get_project(project_id=ee63142a18be4b4e894b8d8097311a63)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:48.449349 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580b716-ab12-4f7e-b921-34dc502a5160 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:48.451003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 224/446] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:48 2022] GET /identity/v3/projects/ee63142a18be4b4e894b8d8097311a63 => generated 303 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:48.451761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b716-ab12-4f7e-b921-34dc502a5160 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:48.479489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:48.516751 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853f64e-2d6f-48dc-b78d-593c08c8247b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:48.552733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb514-d4aa-4076-82a1-f27e1cb5ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:48.553361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb514-d4aa-4076-82a1-f27e1cb5ae87 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.553639 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb514-d4aa-4076-82a1-f27e1cb5ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.553907 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bb514-d4aa-4076-82a1-f27e1cb5ae87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:48.554433 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b716-ab12-4f7e-b921-34dc502a5160 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:48.563967 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bb514-d4aa-4076-82a1-f27e1cb5ae87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f59bb514-d4aa-4076-82a1-f27e1cb5ae87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:48.568773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:48.569713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:48.570519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 223/447] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:48.571238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb514-d4aa-4076-82a1-f27e1cb5ae87 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:48.585107 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:48.592836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c2be-9f8a-4072-9272-f74cc993fedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:48.601760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c2be-9f8a-4072-9272-f74cc993fedc None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.601760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c2be-9f8a-4072-9272-f74cc993fedc None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.601760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c2be-9f8a-4072-9272-f74cc993fedc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:48.601760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c2be-9f8a-4072-9272-f74cc993fedc None admin] RBAC: Adding query filter params (group.id=0b99b23455a74561b47d478e5fd6696b, role.id=7b33619ed33f41c0b797124afa4a385d, scope.project.id=ee63142a18be4b4e894b8d8097311a63) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:48.601760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c2be-9f8a-4072-9272-f74cc993fedc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:48.601760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c2be-9f8a-4072-9272-f74cc993fedc None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:48.603487 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 225/448] 10.222.0.100 () {56 vars in 1381 bytes} [Tue Jul 26 15:11:48 2022] GET /identity/v3/role_assignments?group.id=0b99b23455a74561b47d478e5fd6696b&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=7b33619ed33f41c0b797124afa4a385d => generated 613 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:48.604328 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c2be-9f8a-4072-9272-f74cc993fedc None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:48.684906 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bb514-d4aa-4076-82a1-f27e1cb5ae87 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:48.711203 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:48.722129 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c2be-9f8a-4072-9272-f74cc993fedc None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:48.733297 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4c264-d664-4e05-bdc7-b109b1d8a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:48.733297 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4c264-d664-4e05-bdc7-b109b1d8a86c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.733297 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4c264-d664-4e05-bdc7-b109b1d8a86c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.733297 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4c264-d664-4e05-bdc7-b109b1d8a86c None admin] PATH_INFO: `/v3/groups/0b99b23455a74561b47d478e5fd6696b` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:48.733912 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4c264-d664-4e05-bdc7-b109b1d8a86c None admin] RBAC: Authorizing `identity:get_group(group_id=0b99b23455a74561b47d478e5fd6696b)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:48.733912 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4c264-d664-4e05-bdc7-b109b1d8a86c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:48.733912 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 224/449] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:48 2022] GET /identity/v3/groups/0b99b23455a74561b47d478e5fd6696b => generated 227 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:48.736006 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4c264-d664-4e05-bdc7-b109b1d8a86c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:48.773305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eebaa3-20e2-4e71-8e5a-85d2576eebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:48.773305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eebaa3-20e2-4e71-8e5a-85d2576eebfa None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.773305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eebaa3-20e2-4e71-8e5a-85d2576eebfa None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.773305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eebaa3-20e2-4e71-8e5a-85d2576eebfa None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:48.773850 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eebaa3-20e2-4e71-8e5a-85d2576eebfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:48.773850 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eebaa3-20e2-4e71-8e5a-85d2576eebfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:48.774110 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eebaa3-20e2-4e71-8e5a-85d2576eebfa None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:48.789598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 226/450] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:48 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:48.790591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eebaa3-20e2-4e71-8e5a-85d2576eebfa None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:48.865190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:48.868960 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4c264-d664-4e05-bdc7-b109b1d8a86c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:48.907602 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557d400-3566-40fd-89db-61fa8536e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:48.908311 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557d400-3566-40fd-89db-61fa8536e961 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.908593 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557d400-3566-40fd-89db-61fa8536e961 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.908897 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557d400-3566-40fd-89db-61fa8536e961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:48.910327 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557d400-3566-40fd-89db-61fa8536e961 None admin] RBAC: Adding query filter params (group.id=0b99b23455a74561b47d478e5fd6696b, role.id=11db0567e2634cbb9e76b190bddd6e2a, scope.project.id=ee63142a18be4b4e894b8d8097311a63) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:48.910636 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557d400-3566-40fd-89db-61fa8536e961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:48.912154 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557d400-3566-40fd-89db-61fa8536e961 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:48.919936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 225/451] 10.222.0.100 () {56 vars in 1381 bytes} [Tue Jul 26 15:11:48 2022] GET /identity/v3/role_assignments?group.id=0b99b23455a74561b47d478e5fd6696b&scope.project.id=ee63142a18be4b4e894b8d8097311a63&role.id=11db0567e2634cbb9e76b190bddd6e2a => generated 613 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:48.927706 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eebaa3-20e2-4e71-8e5a-85d2576eebfa None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:48.974984 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2151d40-30e5-480e-8b1c-84fb9f1f55eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:48.975647 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2151d40-30e5-480e-8b1c-84fb9f1f55eb None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:48.975942 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2151d40-30e5-480e-8b1c-84fb9f1f55eb None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:48.976263 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2151d40-30e5-480e-8b1c-84fb9f1f55eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:49.054839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2151d40-30e5-480e-8b1c-84fb9f1f55eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:49.056283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2151d40-30e5-480e-8b1c-84fb9f1f55eb None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:49.117365 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:49.164531 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 227/452] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:49.171277 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557d400-3566-40fd-89db-61fa8536e961 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:49.228916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:49.275615 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557d400-3566-40fd-89db-61fa8536e961 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:49.310510 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e144bc-6d5f-49e1-a794-830d7fff0b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:49.311071 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e144bc-6d5f-49e1-a794-830d7fff0b79 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:49.311351 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e144bc-6d5f-49e1-a794-830d7fff0b79 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:49.311624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e144bc-6d5f-49e1-a794-830d7fff0b79 None admin] PATH_INFO: `/v3/projects/bca50b89fb044b68b53520d35aa1aa1b` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:49.312802 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e144bc-6d5f-49e1-a794-830d7fff0b79 None admin] RBAC: Authorizing `identity:get_project(project_id=bca50b89fb044b68b53520d35aa1aa1b)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:49.314230 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e144bc-6d5f-49e1-a794-830d7fff0b79 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:49.316401 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 226/453] 10.222.0.100 () {56 vars in 1191 bytes} [Tue Jul 26 15:11:49 2022] GET /identity/v3/projects/bca50b89fb044b68b53520d35aa1aa1b => generated 345 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:49.322029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2151d40-30e5-480e-8b1c-84fb9f1f55eb None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:49.418142 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2151d40-30e5-480e-8b1c-84fb9f1f55eb None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:49.450678 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932db1a6-a843-4f96-b533-9814c44caf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:49.451300 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db1a6-a843-4f96-b533-9814c44caf31 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:49.451579 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db1a6-a843-4f96-b533-9814c44caf31 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:49.451852 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932db1a6-a843-4f96-b533-9814c44caf31 None admin] PATH_INFO: `/v3/groups/77e4f394382b4b02958c8de474234de7` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:49.453027 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932db1a6-a843-4f96-b533-9814c44caf31 None admin] RBAC: Authorizing `identity:get_group(group_id=77e4f394382b4b02958c8de474234de7)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:49.454449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932db1a6-a843-4f96-b533-9814c44caf31 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:49.456559 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 228/454] 10.222.0.100 () {56 vars in 1185 bytes} [Tue Jul 26 15:11:49 2022] GET /identity/v3/groups/77e4f394382b4b02958c8de474234de7 => generated 230 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:49.462521 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e144bc-6d5f-49e1-a794-830d7fff0b79 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:49.559741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e144bc-6d5f-49e1-a794-830d7fff0b79 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:49.582744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:49.593186 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8724a9f-d7d6-4bb5-b706-268290ba98a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:49.595334 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8724a9f-d7d6-4bb5-b706-268290ba98a9 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:49.595334 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8724a9f-d7d6-4bb5-b706-268290ba98a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:49.595334 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8724a9f-d7d6-4bb5-b706-268290ba98a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:49.595334 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8724a9f-d7d6-4bb5-b706-268290ba98a9 None admin] RBAC: Adding query filter params (group.id=77e4f394382b4b02958c8de474234de7, role.id=6d23401ca57e47398bf036ea320a7617, scope.project.id=bca50b89fb044b68b53520d35aa1aa1b) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:49.595625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8724a9f-d7d6-4bb5-b706-268290ba98a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:49.596880 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8724a9f-d7d6-4bb5-b706-268290ba98a9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:49.602421 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 227/455] 10.222.0.100 () {56 vars in 1381 bytes} [Tue Jul 26 15:11:49 2022] GET /identity/v3/role_assignments?group.id=77e4f394382b4b02958c8de474234de7&scope.project.id=bca50b89fb044b68b53520d35aa1aa1b&role.id=6d23401ca57e47398bf036ea320a7617 => generated 613 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:52.145947 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361713d-7795-4892-b789-7ebb05185b82 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.146478 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361713d-7795-4892-b789-7ebb05185b82 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.146478 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361713d-7795-4892-b789-7ebb05185b82 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.148238 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 229/456] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:52.154244 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c755357-f956-4873-9a40-246183712417 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.155330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c755357-f956-4873-9a40-246183712417 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.155803 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c755357-f956-4873-9a40-246183712417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.175736 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-5c755357-f956-4873-9a40-246183712417 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:52.177260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-5c755357-f956-4873-9a40-246183712417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:52.252217 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 228/457] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:52.273848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361713d-7795-4892-b789-7ebb05185b82 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:52.290625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ebc0-dcb1-4986-a429-82b14f5159c7 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.291497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ebc0-dcb1-4986-a429-82b14f5159c7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.291934 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ebc0-dcb1-4986-a429-82b14f5159c7 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.293730 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 229/458] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:11:52.301537 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203189-f0d7-4d72-a6bf-388aaeb39dcf None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.302056 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203189-f0d7-4d72-a6bf-388aaeb39dcf None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.302498 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4203189-f0d7-4d72-a6bf-388aaeb39dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.309408 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:52.321622 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c4203189-f0d7-4d72-a6bf-388aaeb39dcf None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:52.323514 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c4203189-f0d7-4d72-a6bf-388aaeb39dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:52.408569 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 230/459] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:52.419671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361713d-7795-4892-b789-7ebb05185b82 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:52.430925 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4203189-f0d7-4d72-a6bf-388aaeb39dcf None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:52.460809 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d8a83-7966-4efc-a320-ad91ea091232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:52.461454 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d8a83-7966-4efc-a320-ad91ea091232 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.461736 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d8a83-7966-4efc-a320-ad91ea091232 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.462012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d8a83-7966-4efc-a320-ad91ea091232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.473526 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d8a83-7966-4efc-a320-ad91ea091232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:52.477778 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d8a83-7966-4efc-a320-ad91ea091232 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:52.490048 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-725d8a83-7966-4efc-a320-ad91ea091232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:52.495760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:52.496687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:52.497621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:52.497621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:52.497621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:52.497621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:52.497621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 230/460] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:52.498507 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315581a0-9e50-41bb-97a6-dad220691057 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.498507 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315581a0-9e50-41bb-97a6-dad220691057 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.498744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315581a0-9e50-41bb-97a6-dad220691057 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.500073 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 231/461] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:52 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:52.503259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315581a0-9e50-41bb-97a6-dad220691057 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:52.554831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4203189-f0d7-4d72-a6bf-388aaeb39dcf None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:52.586246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:52.590457 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22d38f-b261-4477-8904-b4a97e8d1504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:52.591351 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22d38f-b261-4477-8904-b4a97e8d1504 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.591778 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22d38f-b261-4477-8904-b4a97e8d1504 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.592233 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22d38f-b261-4477-8904-b4a97e8d1504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.603849 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22d38f-b261-4477-8904-b4a97e8d1504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:52.605359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22d38f-b261-4477-8904-b4a97e8d1504 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:52.616596 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315581a0-9e50-41bb-97a6-dad220691057 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-4f22d38f-b261-4477-8904-b4a97e8d1504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:52.622831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:52.623768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:52.624660 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:52.624660 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:52.624660 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:52.624660 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:52.628853 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 231/462] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:52.630815 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c594a4-d5bf-419a-88ac-55a406e2bc5b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.631798 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c594a4-d5bf-419a-88ac-55a406e2bc5b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.632314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c594a4-d5bf-419a-88ac-55a406e2bc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.652205 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-98c594a4-d5bf-419a-88ac-55a406e2bc5b None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:52.653405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-98c594a4-d5bf-419a-88ac-55a406e2bc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:52.658828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ef77f-d927-45ba-b360-ce04edea399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:52.660460 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ef77f-d927-45ba-b360-ce04edea399c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.660460 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ef77f-d927-45ba-b360-ce04edea399c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.660733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ef77f-d927-45ba-b360-ce04edea399c None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.661285 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ef77f-d927-45ba-b360-ce04edea399c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:52.661577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ef77f-d927-45ba-b360-ce04edea399c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:52.662953 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ef77f-d927-45ba-b360-ce04edea399c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:52.676881 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 232/463] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:52.682022 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ef77f-d927-45ba-b360-ce04edea399c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:52.736145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 232/464] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:52.736145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c594a4-d5bf-419a-88ac-55a406e2bc5b None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:52.771026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:52.793840 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ef77f-d927-45ba-b360-ce04edea399c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:52.831137 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c569f-9609-4df3-940a-cba2414d9204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:52.831758 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c569f-9609-4df3-940a-cba2414d9204 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.832039 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c569f-9609-4df3-940a-cba2414d9204 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.832349 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c569f-9609-4df3-940a-cba2414d9204 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.833034 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c569f-9609-4df3-940a-cba2414d9204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:52.833337 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c569f-9609-4df3-940a-cba2414d9204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:52.834726 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c569f-9609-4df3-940a-cba2414d9204 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:52.836143 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:52.840937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c594a4-d5bf-419a-88ac-55a406e2bc5b None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:52.847006 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 233/465] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:52.847814 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c569f-9609-4df3-940a-cba2414d9204 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:52.878384 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e34555-e518-4849-8314-ec2e5a354d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:52.879010 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e34555-e518-4849-8314-ec2e5a354d7a None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.879289 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e34555-e518-4849-8314-ec2e5a354d7a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.879545 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e34555-e518-4849-8314-ec2e5a354d7a None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.880260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e34555-e518-4849-8314-ec2e5a354d7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:52.881701 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e34555-e518-4849-8314-ec2e5a354d7a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:52.948423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c569f-9609-4df3-940a-cba2414d9204 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:52.981185 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1210dc-e21d-4fca-926f-d314df395d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:52.981819 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1210dc-e21d-4fca-926f-d314df395d56 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.982098 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1210dc-e21d-4fca-926f-d314df395d56 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.982379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1210dc-e21d-4fca-926f-d314df395d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.983247 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 233/466] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:11:52 2022] POST /identity/v3/users => generated 247 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:52.984581 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9ea65-4f3b-4313-a740-f8b0ac22ce4c None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:52.984867 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9ea65-4f3b-4313-a740-f8b0ac22ce4c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:52.985138 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9ea65-4f3b-4313-a740-f8b0ac22ce4c None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:52.986342 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 234/467] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:52.989132 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9ea65-4f3b-4313-a740-f8b0ac22ce4c None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:53.007425 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1210dc-e21d-4fca-926f-d314df395d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:53.008525 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1210dc-e21d-4fca-926f-d314df395d56 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-4c1210dc-e21d-4fca-926f-d314df395d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:53.025113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:53.026097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:53.026984 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:53.026984 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:53.026984 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:53.026984 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:53.026984 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 234/468] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:53.027708 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc17404-1e9c-46c1-a271-acf83a4aa581 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:53.028039 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc17404-1e9c-46c1-a271-acf83a4aa581 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:53.028254 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc17404-1e9c-46c1-a271-acf83a4aa581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.050627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-5bc17404-1e9c-46c1-a271-acf83a4aa581 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:53.051915 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-5bc17404-1e9c-46c1-a271-acf83a4aa581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:53.096063 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.103680 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.113909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9ea65-4f3b-4313-a740-f8b0ac22ce4c None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:53.131248 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 235/469] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:53.132761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc17404-1e9c-46c1-a271-acf83a4aa581 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:53.156031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49872263-7dcb-4723-be32-76c7a88c1ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:53.157353 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49872263-7dcb-4723-be32-76c7a88c1ab8 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:53.157813 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49872263-7dcb-4723-be32-76c7a88c1ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:53.158255 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49872263-7dcb-4723-be32-76c7a88c1ab8 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.159641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49872263-7dcb-4723-be32-76c7a88c1ab8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:53.161116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49872263-7dcb-4723-be32-76c7a88c1ab8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:53.252511 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc17404-1e9c-46c1-a271-acf83a4aa581 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:53.276190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 235/470] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:11:52 2022] POST /identity/v3/users => generated 249 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:53.277283 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49872263-7dcb-4723-be32-76c7a88c1ab8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:53.294914 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925ef49-cd78-45af-ae50-1c3d43e02ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:53.296667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ef49-cd78-45af-ae50-1c3d43e02ec8 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:53.297413 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ef49-cd78-45af-ae50-1c3d43e02ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:53.297991 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ef49-cd78-45af-ae50-1c3d43e02ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.298924 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925ef49-cd78-45af-ae50-1c3d43e02ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:53.300329 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925ef49-cd78-45af-ae50-1c3d43e02ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:53.302980 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925ef49-cd78-45af-ae50-1c3d43e02ec8 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:53.321223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 236/471] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:53.329029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925ef49-cd78-45af-ae50-1c3d43e02ec8 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:53.384259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.427810 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49872263-7dcb-4723-be32-76c7a88c1ab8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:53.482222 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d3e28-d6f5-49b5-b8c1-f0baeb988573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:53.482874 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3e28-d6f5-49b5-b8c1-f0baeb988573 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:53.482987 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925ef49-cd78-45af-ae50-1c3d43e02ec8 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:53.483161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3e28-d6f5-49b5-b8c1-f0baeb988573 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:53.483424 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d3e28-d6f5-49b5-b8c1-f0baeb988573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.507911 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d3e28-d6f5-49b5-b8c1-f0baeb988573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:53.509356 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d3e28-d6f5-49b5-b8c1-f0baeb988573 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:53.511394 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-3e5d3e28-d6f5-49b5-b8c1-f0baeb988573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:53.525470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:53.526547 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:53.527392 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:53.527392 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:53.527392 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:53.527392 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:53.527614 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce196f8-723e-43c3-9218-d2b884e4573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:53.527614 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce196f8-723e-43c3-9218-d2b884e4573b None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:53.527614 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce196f8-723e-43c3-9218-d2b884e4573b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:53.527819 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 236/472] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:53.527888 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce196f8-723e-43c3-9218-d2b884e4573b None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.527888 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce196f8-723e-43c3-9218-d2b884e4573b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:53.529281 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce196f8-723e-43c3-9218-d2b884e4573b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:53.533922 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d3e28-d6f5-49b5-b8c1-f0baeb988573 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:53.632759 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 237/473] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:11:53 2022] POST /identity/v3/users => generated 249 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:11:53.655907 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d3e28-d6f5-49b5-b8c1-f0baeb988573 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:53.694984 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60be20-d913-4688-964f-90f96ee84357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:53.695719 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60be20-d913-4688-964f-90f96ee84357 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:53.696013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60be20-d913-4688-964f-90f96ee84357 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:53.696330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60be20-d913-4688-964f-90f96ee84357 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.697052 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60be20-d913-4688-964f-90f96ee84357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:53.697360 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60be20-d913-4688-964f-90f96ee84357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:53.698796 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60be20-d913-4688-964f-90f96ee84357 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:53.714012 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 237/474] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:11:53.719559 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce196f8-723e-43c3-9218-d2b884e4573b None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:53.832061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.842693 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce196f8-723e-43c3-9218-d2b884e4573b None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:53.881430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f62ede-8ea6-4b42-80c9-41567918f16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:53.882062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f62ede-8ea6-4b42-80c9-41567918f16a None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:53.882345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f62ede-8ea6-4b42-80c9-41567918f16a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:53.882612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f62ede-8ea6-4b42-80c9-41567918f16a None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:53.883296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f62ede-8ea6-4b42-80c9-41567918f16a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:53.884835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f62ede-8ea6-4b42-80c9-41567918f16a None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:54.002637 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 238/475] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:11:53 2022] POST /identity/v3/users => generated 250 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:11:55.313504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133806dd-3ac6-4bad-93d9-c4da1898a210 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:55.314035 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133806dd-3ac6-4bad-93d9-c4da1898a210 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:55.314035 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133806dd-3ac6-4bad-93d9-c4da1898a210 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:55.316227 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 238/476] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:55.321765 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153dc7e-1c5e-4ae2-8a7a-34201caf9db9 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:55.322212 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153dc7e-1c5e-4ae2-8a7a-34201caf9db9 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:55.322301 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153dc7e-1c5e-4ae2-8a7a-34201caf9db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:55.343307 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-7153dc7e-1c5e-4ae2-8a7a-34201caf9db9 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:55.344521 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-7153dc7e-1c5e-4ae2-8a7a-34201caf9db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:55.415691 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 239/477] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:55.439681 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133806dd-3ac6-4bad-93d9-c4da1898a210 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:55.497387 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:55.546897 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133806dd-3ac6-4bad-93d9-c4da1898a210 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:55.586842 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc24fc-96a2-47a1-860e-5adde3acfd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:55.588002 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc24fc-96a2-47a1-860e-5adde3acfd85 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:55.588466 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc24fc-96a2-47a1-860e-5adde3acfd85 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:55.588906 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc24fc-96a2-47a1-860e-5adde3acfd85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:55.601327 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc24fc-96a2-47a1-860e-5adde3acfd85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-1dbc24fc-96a2-47a1-860e-5adde3acfd85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:55.606473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:55.607583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:11:55.608712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:55.611049 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 239/478] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:55.617440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153dc7e-1c5e-4ae2-8a7a-34201caf9db9 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:55.701931 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:55.724415 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153dc7e-1c5e-4ae2-8a7a-34201caf9db9 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:55.728917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ddf20-449b-4db6-a31d-c6491b25921e None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:55.729494 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ddf20-449b-4db6-a31d-c6491b25921e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:55.729974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ddf20-449b-4db6-a31d-c6491b25921e None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:55.731998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 240/479] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:55 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:55.738363 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31d74f-6e37-41da-8d7a-692945253d8b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:55.738363 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31d74f-6e37-41da-8d7a-692945253d8b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:55.738363 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31d74f-6e37-41da-8d7a-692945253d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:55.757585 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-5e31d74f-6e37-41da-8d7a-692945253d8b None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:55.758828 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-5e31d74f-6e37-41da-8d7a-692945253d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:55.762287 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20ebac-0827-4ccb-9911-b5655b24ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:55.762287 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20ebac-0827-4ccb-9911-b5655b24ede8 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:55.762482 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20ebac-0827-4ccb-9911-b5655b24ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:55.762715 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20ebac-0827-4ccb-9911-b5655b24ede8 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:55.763440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20ebac-0827-4ccb-9911-b5655b24ede8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:55.763740 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20ebac-0827-4ccb-9911-b5655b24ede8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:55.765276 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20ebac-0827-4ccb-9911-b5655b24ede8 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:55.774484 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 240/480] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:11:55 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:55.779979 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20ebac-0827-4ccb-9911-b5655b24ede8 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:55.836306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 241/481] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:55.855574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31d74f-6e37-41da-8d7a-692945253d8b None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:55.889886 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20ebac-0827-4ccb-9911-b5655b24ede8 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:55.912558 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:55.926581 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34047-63a2-44d6-add0-0c277aa8d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:55.927231 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34047-63a2-44d6-add0-0c277aa8d555 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:55.927509 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34047-63a2-44d6-add0-0c277aa8d555 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:55.927788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34047-63a2-44d6-add0-0c277aa8d555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:55.937665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:55.939875 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34047-63a2-44d6-add0-0c277aa8d555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:55.942164 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34047-63a2-44d6-add0-0c277aa8d555 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-cdf34047-63a2-44d6-add0-0c277aa8d555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:55.957901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:55.958823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:55.959687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:55.959687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:55.959687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:55.959687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:55.963840 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 241/482] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:11:55.964913 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34047-63a2-44d6-add0-0c277aa8d555 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:55.980387 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31d74f-6e37-41da-8d7a-692945253d8b None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:56.031329 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb177a2-404b-4f00-a709-54c2039268a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:56.032265 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb177a2-404b-4f00-a709-54c2039268a7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.032700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb177a2-404b-4f00-a709-54c2039268a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.032998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb177a2-404b-4f00-a709-54c2039268a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.047903 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb177a2-404b-4f00-a709-54c2039268a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-0fb177a2-404b-4f00-a709-54c2039268a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:56.058529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:56.059473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:11:56.060408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:56.064596 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 242/483] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:56.065957 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20466-3e85-4dc0-ae76-3f059113ddec None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.066250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20466-3e85-4dc0-ae76-3f059113ddec None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.066946 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20466-3e85-4dc0-ae76-3f059113ddec None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.072344 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 243/484] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:56.072344 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f20466-3e85-4dc0-ae76-3f059113ddec None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:56.092753 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34047-63a2-44d6-add0-0c277aa8d555 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:56.134647 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fa150-4e19-4459-bf0b-5bd788af85e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:56.135331 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa150-4e19-4459-bf0b-5bd788af85e3 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.135611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa150-4e19-4459-bf0b-5bd788af85e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.135884 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa150-4e19-4459-bf0b-5bd788af85e3 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.136917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fa150-4e19-4459-bf0b-5bd788af85e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:56.137565 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fa150-4e19-4459-bf0b-5bd788af85e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:56.139025 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fa150-4e19-4459-bf0b-5bd788af85e3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:56.152815 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 242/485] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:56.154070 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59615076-02be-4ba7-bc80-7ec44f7ebc0d None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.154354 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59615076-02be-4ba7-bc80-7ec44f7ebc0d None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.154847 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59615076-02be-4ba7-bc80-7ec44f7ebc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.175434 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-59615076-02be-4ba7-bc80-7ec44f7ebc0d None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:56.176720 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-59615076-02be-4ba7-bc80-7ec44f7ebc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:56.191167 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f20466-3e85-4dc0-ae76-3f059113ddec None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:56.194480 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:56.228765 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:56.232168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78055f3d-2827-4e3c-b982-ea0ea5b73615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:56.232800 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055f3d-2827-4e3c-b982-ea0ea5b73615 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.233079 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055f3d-2827-4e3c-b982-ea0ea5b73615 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.233352 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78055f3d-2827-4e3c-b982-ea0ea5b73615 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.234066 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78055f3d-2827-4e3c-b982-ea0ea5b73615 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:56.234368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78055f3d-2827-4e3c-b982-ea0ea5b73615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:56.235763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78055f3d-2827-4e3c-b982-ea0ea5b73615 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:56.244744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 244/486] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:11:56 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:56.245556 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78055f3d-2827-4e3c-b982-ea0ea5b73615 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:56.254643 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 243/487] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:56.255590 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59615076-02be-4ba7-bc80-7ec44f7ebc0d None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:56.362651 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78055f3d-2827-4e3c-b982-ea0ea5b73615 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:56.371378 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59615076-02be-4ba7-bc80-7ec44f7ebc0d None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:56.398616 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc18d0-5f07-4582-94be-87cc0aee5fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:56.399172 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc18d0-5f07-4582-94be-87cc0aee5fb5 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.399455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc18d0-5f07-4582-94be-87cc0aee5fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.399730 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc18d0-5f07-4582-94be-87cc0aee5fb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.407462 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc18d0-5f07-4582-94be-87cc0aee5fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:56.408980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc18d0-5f07-4582-94be-87cc0aee5fb5 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:56.409305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44991f-4461-48be-ae6b-4a18c019da17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:56.409958 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44991f-4461-48be-ae6b-4a18c019da17 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.410242 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44991f-4461-48be-ae6b-4a18c019da17 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.410514 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44991f-4461-48be-ae6b-4a18c019da17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.421372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44991f-4461-48be-ae6b-4a18c019da17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:56.422845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44991f-4461-48be-ae6b-4a18c019da17 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-58cc18d0-5f07-4582-94be-87cc0aee5fb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:11:56.422947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:56.423974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 245/488] 10.222.0.100 () {56 vars in 1098 bytes} [Tue Jul 26 15:11:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:56.425540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc18d0-5f07-4582-94be-87cc0aee5fb5 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-ba44991f-4461-48be-ae6b-4a18c019da17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:56.440061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:56.441721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:56.442576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:56.442576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:56.442576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:56.442576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:56.442576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 244/489] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:56.443552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095db52-34e6-44de-b0fa-5cbf97397c89 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.443552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095db52-34e6-44de-b0fa-5cbf97397c89 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.443711 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095db52-34e6-44de-b0fa-5cbf97397c89 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.445069 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 245/490] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:11:56 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:11:56.445606 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095db52-34e6-44de-b0fa-5cbf97397c89 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:56.456415 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:56.481294 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:56.529209 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc18d0-5f07-4582-94be-87cc0aee5fb5 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:56.550853 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095db52-34e6-44de-b0fa-5cbf97397c89 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:56.562493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bc12b-cbd9-4a20-8a8a-e3214b2581ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:56.563132 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bc12b-cbd9-4a20-8a8a-e3214b2581ae None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.563417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bc12b-cbd9-4a20-8a8a-e3214b2581ae None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.563695 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bc12b-cbd9-4a20-8a8a-e3214b2581ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.574285 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bc12b-cbd9-4a20-8a8a-e3214b2581ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-514bc12b-cbd9-4a20-8a8a-e3214b2581ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:56.579753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:56.580851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:11:56.581741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:56.585727 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 246/491] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:56.586552 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bc12b-cbd9-4a20-8a8a-e3214b2581ae None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:56.586818 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c9c03-3a5f-4b32-804b-7fb770d8ac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:56.587445 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9c03-3a5f-4b32-804b-7fb770d8ac6d None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.587732 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9c03-3a5f-4b32-804b-7fb770d8ac6d None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.588007 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c9c03-3a5f-4b32-804b-7fb770d8ac6d None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.588844 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c9c03-3a5f-4b32-804b-7fb770d8ac6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:56.589155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c9c03-3a5f-4b32-804b-7fb770d8ac6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:56.590725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c9c03-3a5f-4b32-804b-7fb770d8ac6d None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:56.628886 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 246/492] 10.222.0.100 () {56 vars in 1138 bytes} [Tue Jul 26 15:11:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:56.630004 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846bb0f-b371-46b8-8fd5-1ea2011bbcef None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.630302 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846bb0f-b371-46b8-8fd5-1ea2011bbcef None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.630582 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846bb0f-b371-46b8-8fd5-1ea2011bbcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.649917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-4846bb0f-b371-46b8-8fd5-1ea2011bbcef None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:11:56.651038 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-4846bb0f-b371-46b8-8fd5-1ea2011bbcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:11:56.673705 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:56.688490 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bc12b-cbd9-4a20-8a8a-e3214b2581ae None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:56.719597 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 247/493] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:11:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:56.720467 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846bb0f-b371-46b8-8fd5-1ea2011bbcef None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:56.722943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bf2d5-3cc4-4079-a3fa-de5049ee4e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:56.723559 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bf2d5-3cc4-4079-a3fa-de5049ee4e36 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.723843 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bf2d5-3cc4-4079-a3fa-de5049ee4e36 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.724140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bf2d5-3cc4-4079-a3fa-de5049ee4e36 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.724840 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bf2d5-3cc4-4079-a3fa-de5049ee4e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:56.725145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bf2d5-3cc4-4079-a3fa-de5049ee4e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:56.726532 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bf2d5-3cc4-4079-a3fa-de5049ee4e36 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:56.745694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:56.747282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 247/494] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:56.748187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bf2d5-3cc4-4079-a3fa-de5049ee4e36 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:56.824594 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846bb0f-b371-46b8-8fd5-1ea2011bbcef None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:56.847111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bf2d5-3cc4-4079-a3fa-de5049ee4e36 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:56.860280 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d46b15-6b73-4304-bbe5-ea6e5f550a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:56.860899 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d46b15-6b73-4304-bbe5-ea6e5f550a90 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.861182 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d46b15-6b73-4304-bbe5-ea6e5f550a90 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.861460 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d46b15-6b73-4304-bbe5-ea6e5f550a90 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.862748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d46b15-6b73-4304-bbe5-ea6e5f550a90 None admin] RBAC: Adding query filter params (name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:56.863048 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d46b15-6b73-4304-bbe5-ea6e5f550a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:56.864463 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d46b15-6b73-4304-bbe5-ea6e5f550a90 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:56.872471 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 248/495] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:11:56 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:56.873292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d46b15-6b73-4304-bbe5-ea6e5f550a90 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:56.885820 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b467ef-602a-4f55-8dd1-b3612adceac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:56.886435 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b467ef-602a-4f55-8dd1-b3612adceac2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:56.886719 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b467ef-602a-4f55-8dd1-b3612adceac2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:56.886995 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b467ef-602a-4f55-8dd1-b3612adceac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:56.902046 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:56.954675 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b467ef-602a-4f55-8dd1-b3612adceac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:56.956343 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b467ef-602a-4f55-8dd1-b3612adceac2 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:56.959069 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:56.975133 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d46b15-6b73-4304-bbe5-ea6e5f550a90 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.009464 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e70f7-c176-4111-898e-d9454fa08a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.010107 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e70f7-c176-4111-898e-d9454fa08a89 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.010390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e70f7-c176-4111-898e-d9454fa08a89 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.010672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e70f7-c176-4111-898e-d9454fa08a89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.020857 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e70f7-c176-4111-898e-d9454fa08a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-e78e70f7-c176-4111-898e-d9454fa08a89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:11:57.025761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:57.026667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:57.027488 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 249/496] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:57.028197 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e70f7-c176-4111-898e-d9454fa08a89 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.054988 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 248/497] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:57.055933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b467ef-602a-4f55-8dd1-b3612adceac2 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.103672 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:57.132524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e70f7-c176-4111-898e-d9454fa08a89 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.155638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b467ef-602a-4f55-8dd1-b3612adceac2 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.168410 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8125c-3900-4006-b438-fa173e12ef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.169054 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8125c-3900-4006-b438-fa173e12ef78 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.169338 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8125c-3900-4006-b438-fa173e12ef78 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.169617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8125c-3900-4006-b438-fa173e12ef78 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.176754 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8125c-3900-4006-b438-fa173e12ef78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:57.178234 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8125c-3900-4006-b438-fa173e12ef78 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:57.190824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c9779-4091-4a13-9ec9-a78356a9b024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-ffe8125c-3900-4006-b438-fa173e12ef78 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:11:57.191206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:57.192293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:57.193223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:57.193223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:57.193223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:11:57.193223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:11:57.193223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:11:57.193223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:11:57.193223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:11:57.193223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:11:57.193223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:11:57.193223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:57.193733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9779-4091-4a13-9ec9-a78356a9b024 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.193733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9779-4091-4a13-9ec9-a78356a9b024 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.193733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9779-4091-4a13-9ec9-a78356a9b024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.193914 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 250/498] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:57.193914 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8125c-3900-4006-b438-fa173e12ef78 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.198056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:57.204461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c9779-4091-4a13-9ec9-a78356a9b024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:57.209557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c9779-4091-4a13-9ec9-a78356a9b024 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-7f8c9779-4091-4a13-9ec9-a78356a9b024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:57.222038 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:57.222932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:57.223801 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:57.223801 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:57.223801 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:57.223801 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:57.223801 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 249/499] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:57.224325 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c9779-4091-4a13-9ec9-a78356a9b024 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.305828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8125c-3900-4006-b438-fa173e12ef78 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.321644 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:57.325406 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c9779-4091-4a13-9ec9-a78356a9b024 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.340568 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8309ed1-e122-44e8-a549-558b9f707846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.341196 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8309ed1-e122-44e8-a549-558b9f707846 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.341530 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8309ed1-e122-44e8-a549-558b9f707846 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.341804 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8309ed1-e122-44e8-a549-558b9f707846 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.342524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8309ed1-e122-44e8-a549-558b9f707846 None admin] RBAC: Adding query filter params (name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:57.342827 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8309ed1-e122-44e8-a549-558b9f707846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:57.344248 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8309ed1-e122-44e8-a549-558b9f707846 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:57.354061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 251/500] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:57.354889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8309ed1-e122-44e8-a549-558b9f707846 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.368036 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a610a-6a99-4fb9-9b49-2a50008de593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.368707 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a610a-6a99-4fb9-9b49-2a50008de593 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.369911 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a610a-6a99-4fb9-9b49-2a50008de593 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.369911 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a610a-6a99-4fb9-9b49-2a50008de593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.380671 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a610a-6a99-4fb9-9b49-2a50008de593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:57.382128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a610a-6a99-4fb9-9b49-2a50008de593 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-767a610a-6a99-4fb9-9b49-2a50008de593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:57.396219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:57.397190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:57.398062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:57.398062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:57.398062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:57.398062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:57.398062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 250/501] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:57.398336 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a610a-6a99-4fb9-9b49-2a50008de593 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.422379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:57.458160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8309ed1-e122-44e8-a549-558b9f707846 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.493435 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff676c46-9ecf-4bde-9f16-8f75ab038966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.494061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff676c46-9ecf-4bde-9f16-8f75ab038966 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.494344 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff676c46-9ecf-4bde-9f16-8f75ab038966 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.494622 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff676c46-9ecf-4bde-9f16-8f75ab038966 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.495408 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff676c46-9ecf-4bde-9f16-8f75ab038966 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:57.495871 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff676c46-9ecf-4bde-9f16-8f75ab038966 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:57.497351 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff676c46-9ecf-4bde-9f16-8f75ab038966 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:57.502407 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a610a-6a99-4fb9-9b49-2a50008de593 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.515038 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 252/502] 10.222.0.100 () {56 vars in 1142 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:57.516061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff676c46-9ecf-4bde-9f16-8f75ab038966 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.537242 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b906b32-70c3-454b-aa7b-255d595d7312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.537852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b906b32-70c3-454b-aa7b-255d595d7312 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.538135 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b906b32-70c3-454b-aa7b-255d595d7312 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.538405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b906b32-70c3-454b-aa7b-255d595d7312 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.539086 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b906b32-70c3-454b-aa7b-255d595d7312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:57.539385 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b906b32-70c3-454b-aa7b-255d595d7312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:57.540798 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b906b32-70c3-454b-aa7b-255d595d7312 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:57.553323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 251/503] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:57.554128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b906b32-70c3-454b-aa7b-255d595d7312 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.566004 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:57.628911 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff676c46-9ecf-4bde-9f16-8f75ab038966 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.651610 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b906b32-70c3-454b-aa7b-255d595d7312 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.652897 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:57.663686 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f9d25-0a66-4532-8927-93324e49fb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.664367 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f9d25-0a66-4532-8927-93324e49fb68 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.664648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f9d25-0a66-4532-8927-93324e49fb68 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.664924 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f9d25-0a66-4532-8927-93324e49fb68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.687355 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f9d25-0a66-4532-8927-93324e49fb68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:57.687355 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f9d25-0a66-4532-8927-93324e49fb68 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:57.687568 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937fae-4540-4668-be72-c80b4843467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.687568 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937fae-4540-4668-be72-c80b4843467d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.687568 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937fae-4540-4668-be72-c80b4843467d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.687568 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3937fae-4540-4668-be72-c80b4843467d None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.687849 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3937fae-4540-4668-be72-c80b4843467d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:57.687849 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3937fae-4540-4668-be72-c80b4843467d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:57.688441 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3937fae-4540-4668-be72-c80b4843467d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-916f9d25-0a66-4532-8927-93324e49fb68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:57.691823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:57.692806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:57.693675 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:57.693675 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:57.693675 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:57.693675 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:57.693675 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 253/504] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:57.693948 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f9d25-0a66-4532-8927-93324e49fb68 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.704596 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 252/505] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:57.704596 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937fae-4540-4668-be72-c80b4843467d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.773070 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:57.801011 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f9d25-0a66-4532-8927-93324e49fb68 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.803301 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3937fae-4540-4668-be72-c80b4843467d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.835297 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b6ab-17c9-45b9-9dc6-1b9d81b216f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.835902 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b6ab-17c9-45b9-9dc6-1b9d81b216f3 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.836231 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b6ab-17c9-45b9-9dc6-1b9d81b216f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.836494 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08242776-7b01-4d5e-b3ce-76172c7b567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.836635 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7b6ab-17c9-45b9-9dc6-1b9d81b216f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.837126 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242776-7b01-4d5e-b3ce-76172c7b567e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.837412 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242776-7b01-4d5e-b3ce-76172c7b567e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.837691 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08242776-7b01-4d5e-b3ce-76172c7b567e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.845248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08242776-7b01-4d5e-b3ce-76172c7b567e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:57.847359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08242776-7b01-4d5e-b3ce-76172c7b567e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-08242776-7b01-4d5e-b3ce-76172c7b567e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:11:57.859156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:57.860074 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:57.861128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 253/506] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:57.861696 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08242776-7b01-4d5e-b3ce-76172c7b567e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:57.886746 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:57.909957 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7b6ab-17c9-45b9-9dc6-1b9d81b216f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:57.911428 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7b6ab-17c9-45b9-9dc6-1b9d81b216f3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:57.964171 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08242776-7b01-4d5e-b3ce-76172c7b567e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:57.991715 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:57.997433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3be77-f4d5-414d-a034-9963fb34a9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:57.998045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3be77-f4d5-414d-a034-9963fb34a9e7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:57.998374 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3be77-f4d5-414d-a034-9963fb34a9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:57.998614 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3be77-f4d5-414d-a034-9963fb34a9e7 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:57.999305 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3be77-f4d5-414d-a034-9963fb34a9e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:57.999610 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3be77-f4d5-414d-a034-9963fb34a9e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:58.001028 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3be77-f4d5-414d-a034-9963fb34a9e7 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:58.012565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 254/508] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:58.012774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 254/508] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:58.013391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3be77-f4d5-414d-a034-9963fb34a9e7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.014259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b6ab-17c9-45b9-9dc6-1b9d81b216f3 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.093199 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.114918 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3be77-f4d5-414d-a034-9963fb34a9e7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.115114 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7b6ab-17c9-45b9-9dc6-1b9d81b216f3 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.150560 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e1cd3-49b4-460e-9d00-007d22842a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.151229 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e1cd3-49b4-460e-9d00-007d22842a81 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.151516 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e1cd3-49b4-460e-9d00-007d22842a81 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.151786 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e1cd3-49b4-460e-9d00-007d22842a81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.152606 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f8519-9d6e-4ab8-bce9-c3d94c7dab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.153225 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8519-9d6e-4ab8-bce9-c3d94c7dab38 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.153509 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8519-9d6e-4ab8-bce9-c3d94c7dab38 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.153944 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8519-9d6e-4ab8-bce9-c3d94c7dab38 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.155054 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f8519-9d6e-4ab8-bce9-c3d94c7dab38 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:58.155360 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f8519-9d6e-4ab8-bce9-c3d94c7dab38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:58.156877 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f8519-9d6e-4ab8-bce9-c3d94c7dab38 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:58.158846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e1cd3-49b4-460e-9d00-007d22842a81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:58.160541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e1cd3-49b4-460e-9d00-007d22842a81 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-ca8e1cd3-49b4-460e-9d00-007d22842a81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:11:58.173996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:58.175378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:58.176492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:11:58.176492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:11:58.176492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:11:58.176492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:11:58.176492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:11:58.176492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:11:58.176492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:11:58.176492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:58.176492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 255/509] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:58.176492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e1cd3-49b4-460e-9d00-007d22842a81 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.180953 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 255/510] 10.222.0.100 () {56 vars in 1142 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:58.181928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f8519-9d6e-4ab8-bce9-c3d94c7dab38 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.227121 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.275329 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e1cd3-49b4-460e-9d00-007d22842a81 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.282289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f8519-9d6e-4ab8-bce9-c3d94c7dab38 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.310470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17155a-54ac-4abb-bac8-b2c7ba98f7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.311090 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17155a-54ac-4abb-bac8-b2c7ba98f7a3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.311367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17155a-54ac-4abb-bac8-b2c7ba98f7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.311639 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17155a-54ac-4abb-bac8-b2c7ba98f7a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.317202 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf713787-2972-49dc-81d2-08dd966c2e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.317831 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf713787-2972-49dc-81d2-08dd966c2e10 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.318104 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf713787-2972-49dc-81d2-08dd966c2e10 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.318373 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf713787-2972-49dc-81d2-08dd966c2e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.318463 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17155a-54ac-4abb-bac8-b2c7ba98f7a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:58.319902 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17155a-54ac-4abb-bac8-b2c7ba98f7a3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:58.320339 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.328991 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf713787-2972-49dc-81d2-08dd966c2e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:58.330433 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf713787-2972-49dc-81d2-08dd966c2e10 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-3d17155a-54ac-4abb-bac8-b2c7ba98f7a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:11:58.331271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:58.334921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 256/511] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:58.335824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17155a-54ac-4abb-bac8-b2c7ba98f7a3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-bf713787-2972-49dc-81d2-08dd966c2e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:58.350955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:58.351848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:58.352743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:58.352743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:58.352743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:58.352743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:58.352743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 256/512] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:58.353536 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf713787-2972-49dc-81d2-08dd966c2e10 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.435748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17155a-54ac-4abb-bac8-b2c7ba98f7a3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.446226 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.454296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf713787-2972-49dc-81d2-08dd966c2e10 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.468894 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f9e26-e1f3-4eee-a880-215491d0e1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.469499 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f9e26-e1f3-4eee-a880-215491d0e1f3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.469780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f9e26-e1f3-4eee-a880-215491d0e1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.470056 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f9e26-e1f3-4eee-a880-215491d0e1f3 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.470807 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f9e26-e1f3-4eee-a880-215491d0e1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:58.471623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f9e26-e1f3-4eee-a880-215491d0e1f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:58.473198 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f9e26-e1f3-4eee-a880-215491d0e1f3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:58.491013 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97988cc-6ef8-4a50-9b1b-309833cff3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.491637 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97988cc-6ef8-4a50-9b1b-309833cff3f9 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.491926 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97988cc-6ef8-4a50-9b1b-309833cff3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.492048 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 257/513] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:58.492229 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97988cc-6ef8-4a50-9b1b-309833cff3f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.492903 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f9e26-e1f3-4eee-a880-215491d0e1f3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.550046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.567158 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97988cc-6ef8-4a50-9b1b-309833cff3f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:58.568674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97988cc-6ef8-4a50-9b1b-309833cff3f9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:58.606332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f9e26-e1f3-4eee-a880-215491d0e1f3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.639409 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392d93-4e7e-4cba-aeea-3c9f7ea3e378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.640008 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392d93-4e7e-4cba-aeea-3c9f7ea3e378 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.640318 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392d93-4e7e-4cba-aeea-3c9f7ea3e378 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.640590 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e392d93-4e7e-4cba-aeea-3c9f7ea3e378 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.641368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e392d93-4e7e-4cba-aeea-3c9f7ea3e378 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:58.641671 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e392d93-4e7e-4cba-aeea-3c9f7ea3e378 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:58.643627 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e392d93-4e7e-4cba-aeea-3c9f7ea3e378 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:58.669147 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 257/514] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:58.670070 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97988cc-6ef8-4a50-9b1b-309833cff3f9 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.682265 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 258/515] 10.222.0.100 () {56 vars in 1144 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:58.682992 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392d93-4e7e-4cba-aeea-3c9f7ea3e378 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.711031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.755955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.770603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97988cc-6ef8-4a50-9b1b-309833cff3f9 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.781222 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e392d93-4e7e-4cba-aeea-3c9f7ea3e378 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.806155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ac214-5ad1-47cf-8ab9-92c6636a9d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.806765 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ac214-5ad1-47cf-8ab9-92c6636a9d10 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.807046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ac214-5ad1-47cf-8ab9-92c6636a9d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.807318 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ac214-5ad1-47cf-8ab9-92c6636a9d10 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.808001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ac214-5ad1-47cf-8ab9-92c6636a9d10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:58.808336 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ac214-5ad1-47cf-8ab9-92c6636a9d10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:58.809719 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ac214-5ad1-47cf-8ab9-92c6636a9d10 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:58.816647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79074db3-6e78-4609-8834-ca633e781959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.817255 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79074db3-6e78-4609-8834-ca633e781959 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.817879 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79074db3-6e78-4609-8834-ca633e781959 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.817879 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79074db3-6e78-4609-8834-ca633e781959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:58.818683 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79074db3-6e78-4609-8834-ca633e781959 None admin] RBAC: Adding query filter params (role.id=58cdb402595a4191aa19b0b3a4ad8827, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=dcc3cee241bd45c49e37124cc4dd6e34) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:58.818986 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79074db3-6e78-4609-8834-ca633e781959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:58.820423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79074db3-6e78-4609-8834-ca633e781959 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:58.821597 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 258/516] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:58.822523 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ac214-5ad1-47cf-8ab9-92c6636a9d10 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.825977 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 259/517] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/role_assignments?user.id=dcc3cee241bd45c49e37124cc4dd6e34&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=58cdb402595a4191aa19b0b3a4ad8827 => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:58.826935 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79074db3-6e78-4609-8834-ca633e781959 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:58.939831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.949521 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79074db3-6e78-4609-8834-ca633e781959 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.961227 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ac214-5ad1-47cf-8ab9-92c6636a9d10 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:58.993167 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea954d2-5556-48c3-a850-9f1387c14c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:58.993909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea954d2-5556-48c3-a850-9f1387c14c34 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:58.994195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea954d2-5556-48c3-a850-9f1387c14c34 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:58.994489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea954d2-5556-48c3-a850-9f1387c14c34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.000561 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35d36a-085d-4f0e-9cba-ab11963a5223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:59.002805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35d36a-085d-4f0e-9cba-ab11963a5223 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:59.002805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35d36a-085d-4f0e-9cba-ab11963a5223 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:59.002805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35d36a-085d-4f0e-9cba-ab11963a5223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.014949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35d36a-085d-4f0e-9cba-ab11963a5223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.016464 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35d36a-085d-4f0e-9cba-ab11963a5223 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.024402 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-fb35d36a-085d-4f0e-9cba-ab11963a5223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:59.033018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:59.034440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:59.035289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:59.035289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:59.035289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:59.035289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:59.035289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 259/518] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:59.035574 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35d36a-085d-4f0e-9cba-ab11963a5223 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:59.079143 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea954d2-5556-48c3-a850-9f1387c14c34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.080682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea954d2-5556-48c3-a850-9f1387c14c34 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.149751 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35d36a-085d-4f0e-9cba-ab11963a5223 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:59.184163 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:59.192623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 260/519] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:11:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:59.193469 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea954d2-5556-48c3-a850-9f1387c14c34 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:59.204086 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02270-17ec-4c95-bfa1-70bb704ea106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:59.204898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02270-17ec-4c95-bfa1-70bb704ea106 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:59.205403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02270-17ec-4c95-bfa1-70bb704ea106 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:59.205621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef02270-17ec-4c95-bfa1-70bb704ea106 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.214212 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef02270-17ec-4c95-bfa1-70bb704ea106 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.217339 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef02270-17ec-4c95-bfa1-70bb704ea106 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-eef02270-17ec-4c95-bfa1-70bb704ea106 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:11:59.231345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:59.232298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:59.239239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:11:59.239239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:11:59.239239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:11:59.239239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:11:59.239239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:11:59.239239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:11:59.239239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:11:59.239239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:59.239239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 260/520] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:59.239239 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02270-17ec-4c95-bfa1-70bb704ea106 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:59.300207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:59.311893 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea954d2-5556-48c3-a850-9f1387c14c34 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:59.347027 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef02270-17ec-4c95-bfa1-70bb704ea106 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:59.347988 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5fb32-a22d-44b5-8062-b58ca2054ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:59.348643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fb32-a22d-44b5-8062-b58ca2054ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:59.348926 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fb32-a22d-44b5-8062-b58ca2054ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:59.349197 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5fb32-a22d-44b5-8062-b58ca2054ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.349893 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fb32-a22d-44b5-8062-b58ca2054ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:59.350194 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fb32-a22d-44b5-8062-b58ca2054ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.351569 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5fb32-a22d-44b5-8062-b58ca2054ea9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.363525 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 261/521] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:59.364399 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5fb32-a22d-44b5-8062-b58ca2054ea9 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:59.392676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6b76e-0ff8-4077-8a70-18e478545566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:59.393791 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6b76e-0ff8-4077-8a70-18e478545566 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:59.394069 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6b76e-0ff8-4077-8a70-18e478545566 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:59.394510 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6b76e-0ff8-4077-8a70-18e478545566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.406347 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6b76e-0ff8-4077-8a70-18e478545566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.407496 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6b76e-0ff8-4077-8a70-18e478545566 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.421476 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-74f6b76e-0ff8-4077-8a70-18e478545566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:11:59.423134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:59.424230 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:59.425246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:11:59.425246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:11:59.425246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:11:59.425246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:59.425246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 261/522] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:59.425246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6b76e-0ff8-4077-8a70-18e478545566 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:59.485621 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5fb32-a22d-44b5-8062-b58ca2054ea9 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:59.520058 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d37c3-b613-4e4b-bfdf-fbf201274b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:59.520704 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d37c3-b613-4e4b-bfdf-fbf201274b4a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:59.520988 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d37c3-b613-4e4b-bfdf-fbf201274b4a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:59.521257 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d37c3-b613-4e4b-bfdf-fbf201274b4a None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.522004 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d37c3-b613-4e4b-bfdf-fbf201274b4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:59.522314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d37c3-b613-4e4b-bfdf-fbf201274b4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.523759 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d37c3-b613-4e4b-bfdf-fbf201274b4a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.541762 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 262/523] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:59.541762 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d37c3-b613-4e4b-bfdf-fbf201274b4a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:59.546922 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6b76e-0ff8-4077-8a70-18e478545566 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:59.559199 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:59.585146 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf48ee-0f5c-41b9-840a-7e3eb9e0a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:59.585893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf48ee-0f5c-41b9-840a-7e3eb9e0a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:59.586255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf48ee-0f5c-41b9-840a-7e3eb9e0a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:59.586602 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf48ee-0f5c-41b9-840a-7e3eb9e0a5d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.593843 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf48ee-0f5c-41b9-840a-7e3eb9e0a5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.595823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf48ee-0f5c-41b9-840a-7e3eb9e0a5d8 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-42cf48ee-0f5c-41b9-840a-7e3eb9e0a5d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:11:59.608998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:59.609893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:59.610836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:11:59.610836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:11:59.610836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:11:59.610836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:11:59.610836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:11:59.610836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:11:59.610836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:11:59.610836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:59.615398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 262/524] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:11:59.616088 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf48ee-0f5c-41b9-840a-7e3eb9e0a5d8 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:59.648918 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d37c3-b613-4e4b-bfdf-fbf201274b4a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:59.664057 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:59.685993 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf6e3-5a17-48be-916b-d46b474f8693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:59.686416 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf6e3-5a17-48be-916b-d46b474f8693 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:59.686705 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf6e3-5a17-48be-916b-d46b474f8693 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:59.686982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf6e3-5a17-48be-916b-d46b474f8693 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.687664 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf6e3-5a17-48be-916b-d46b474f8693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:59.687968 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf6e3-5a17-48be-916b-d46b474f8693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.689383 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bf6e3-5a17-48be-916b-d46b474f8693 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.702697 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 263/525] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:11:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:59.707390 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf6e3-5a17-48be-916b-d46b474f8693 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:59.727787 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf48ee-0f5c-41b9-840a-7e3eb9e0a5d8 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:59.763877 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cde60-8da0-4bf4-bd27-b95a1adfe499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:59.765098 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cde60-8da0-4bf4-bd27-b95a1adfe499 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:59.765385 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cde60-8da0-4bf4-bd27-b95a1adfe499 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:59.765661 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92cde60-8da0-4bf4-bd27-b95a1adfe499 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.766458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cde60-8da0-4bf4-bd27-b95a1adfe499 None admin] RBAC: Adding query filter params (role.id=58cdb402595a4191aa19b0b3a4ad8827, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=4f62b11cb0dc462caeacfdba8cd45658) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:59.766783 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cde60-8da0-4bf4-bd27-b95a1adfe499 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.768799 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92cde60-8da0-4bf4-bd27-b95a1adfe499 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.774636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 263/526] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:59 2022] GET /identity/v3/role_assignments?user.id=4f62b11cb0dc462caeacfdba8cd45658&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=58cdb402595a4191aa19b0b3a4ad8827 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:59.775410 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cde60-8da0-4bf4-bd27-b95a1adfe499 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:59.824100 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:59.826876 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf6e3-5a17-48be-916b-d46b474f8693 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:59.872585 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7638e1-5217-4861-80e9-89b0b155ba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:59.873391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7638e1-5217-4861-80e9-89b0b155ba9d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:59.873692 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7638e1-5217-4861-80e9-89b0b155ba9d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:59.873972 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7638e1-5217-4861-80e9-89b0b155ba9d None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.875645 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7638e1-5217-4861-80e9-89b0b155ba9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:11:59.875983 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7638e1-5217-4861-80e9-89b0b155ba9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.878050 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7638e1-5217-4861-80e9-89b0b155ba9d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.894574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 264/527] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:11:59.900090 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7638e1-5217-4861-80e9-89b0b155ba9d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:11:59.922551 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92cde60-8da0-4bf4-bd27-b95a1adfe499 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:11:59.938265 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:59.966830 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53922b-aadc-4c45-ad9b-625beb928562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:11:59.966830 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53922b-aadc-4c45-ad9b-625beb928562 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:11:59.967179 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53922b-aadc-4c45-ad9b-625beb928562 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:11:59.967351 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53922b-aadc-4c45-ad9b-625beb928562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:11:59.976672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53922b-aadc-4c45-ad9b-625beb928562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:11:59.978617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53922b-aadc-4c45-ad9b-625beb928562 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-bf53922b-aadc-4c45-ad9b-625beb928562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:11:59.993941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:11:59.994860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:11:59.996162 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:11:59.996162 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:11:59.996162 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:11:59.996162 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:11:59.996162 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:11:59.996162 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:11:59.996162 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:11:59.996162 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:11:59.996162 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 264/528] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:00.002303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53922b-aadc-4c45-ad9b-625beb928562 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:00.035291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7638e1-5217-4861-80e9-89b0b155ba9d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:00.079304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551feee-93a3-46ad-8baf-eff06e5b5e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:00.080187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551feee-93a3-46ad-8baf-eff06e5b5e42 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:00.080562 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551feee-93a3-46ad-8baf-eff06e5b5e42 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:00.081069 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551feee-93a3-46ad-8baf-eff06e5b5e42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:00.081870 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551feee-93a3-46ad-8baf-eff06e5b5e42 None admin] RBAC: Adding query filter params (role.id=58cdb402595a4191aa19b0b3a4ad8827, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=c5e22a12ebdd493c8c14cfaf2dfc1af2) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:00.082345 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551feee-93a3-46ad-8baf-eff06e5b5e42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:00.084385 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551feee-93a3-46ad-8baf-eff06e5b5e42 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:00.091124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 265/529] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:11:59 2022] GET /identity/v3/role_assignments?user.id=c5e22a12ebdd493c8c14cfaf2dfc1af2&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=58cdb402595a4191aa19b0b3a4ad8827 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:00.137802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:00.145996 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53922b-aadc-4c45-ad9b-625beb928562 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:00.189593 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e34f6-cadd-4da8-9be9-695eaad5408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:00.190326 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e34f6-cadd-4da8-9be9-695eaad5408b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:00.190611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e34f6-cadd-4da8-9be9-695eaad5408b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:00.190890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e34f6-cadd-4da8-9be9-695eaad5408b None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:00.191674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e34f6-cadd-4da8-9be9-695eaad5408b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:00.191991 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e34f6-cadd-4da8-9be9-695eaad5408b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:00.193598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e34f6-cadd-4da8-9be9-695eaad5408b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:00.215514 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 265/530] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:00.222354 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551feee-93a3-46ad-8baf-eff06e5b5e42 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:00.335770 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:00.342454 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551feee-93a3-46ad-8baf-eff06e5b5e42 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:00.378191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273ee4d-2226-43fa-abf8-12599d461c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:00.379051 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273ee4d-2226-43fa-abf8-12599d461c16 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:00.379485 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273ee4d-2226-43fa-abf8-12599d461c16 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:00.379904 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273ee4d-2226-43fa-abf8-12599d461c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:00.380899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273ee4d-2226-43fa-abf8-12599d461c16 None admin] RBAC: Adding query filter params (role.id=58cdb402595a4191aa19b0b3a4ad8827, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=50361b26fc1441ea9e78b3f59f1e4f8f) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:00.381380 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273ee4d-2226-43fa-abf8-12599d461c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:00.382953 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273ee4d-2226-43fa-abf8-12599d461c16 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:00.389164 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 266/531] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:12:00 2022] GET /identity/v3/role_assignments?user.id=50361b26fc1441ea9e78b3f59f1e4f8f&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=58cdb402595a4191aa19b0b3a4ad8827 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:01.117400 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a753a-49f7-4615-8a82-b6c62ea9ad43 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:01.117964 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a753a-49f7-4615-8a82-b6c62ea9ad43 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:01.117964 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a753a-49f7-4615-8a82-b6c62ea9ad43 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:01.119428 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 266/532] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:01.125437 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea3b85-6e6b-4f4b-882b-021fd3c08f52 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:01.131763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea3b85-6e6b-4f4b-882b-021fd3c08f52 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:01.131763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea3b85-6e6b-4f4b-882b-021fd3c08f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:01.146050 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-53ea3b85-6e6b-4f4b-882b-021fd3c08f52 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:01.147556 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-53ea3b85-6e6b-4f4b-882b-021fd3c08f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:01.225813 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 267/533] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:12:01.250502 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a753a-49f7-4615-8a82-b6c62ea9ad43 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:01.361470 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a753a-49f7-4615-8a82-b6c62ea9ad43 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:01.396985 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527c4ff-7bef-4603-b2bf-70d278959008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:01.397548 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527c4ff-7bef-4603-b2bf-70d278959008 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:01.397829 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527c4ff-7bef-4603-b2bf-70d278959008 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:01.398104 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527c4ff-7bef-4603-b2bf-70d278959008 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:01.408646 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527c4ff-7bef-4603-b2bf-70d278959008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-f527c4ff-7bef-4603-b2bf-70d278959008 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:01.414912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:01.416035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:01.416917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 267/534] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:12:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:01.423842 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea3b85-6e6b-4f4b-882b-021fd3c08f52 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:01.523940 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:01.533853 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea3b85-6e6b-4f4b-882b-021fd3c08f52 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:01.572789 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65e33e-89a0-49e2-87ec-8b51e69e6f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:01.573430 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65e33e-89a0-49e2-87ec-8b51e69e6f30 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:01.573715 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65e33e-89a0-49e2-87ec-8b51e69e6f30 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:01.573988 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65e33e-89a0-49e2-87ec-8b51e69e6f30 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:01.574728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65e33e-89a0-49e2-87ec-8b51e69e6f30 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:01.575033 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65e33e-89a0-49e2-87ec-8b51e69e6f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:01.576532 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65e33e-89a0-49e2-87ec-8b51e69e6f30 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:01.586054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 268/535] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:12:01 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:01.593310 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527c4ff-7bef-4603-b2bf-70d278959008 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:01.617668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:01.701679 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527c4ff-7bef-4603-b2bf-70d278959008 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:01.737878 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659c87c-4e15-46d0-b4cc-200b1ffcd65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:01.738936 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659c87c-4e15-46d0-b4cc-200b1ffcd65c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:01.739459 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659c87c-4e15-46d0-b4cc-200b1ffcd65c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:01.739936 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659c87c-4e15-46d0-b4cc-200b1ffcd65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:01.751664 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659c87c-4e15-46d0-b4cc-200b1ffcd65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:01.753718 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659c87c-4e15-46d0-b4cc-200b1ffcd65c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-b659c87c-4e15-46d0-b4cc-200b1ffcd65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:01.768904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:01.769800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:01.770653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:01.770653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:01.770653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:01.770653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:01.772831 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 268/536] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:01.781214 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65e33e-89a0-49e2-87ec-8b51e69e6f30 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:01.888674 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65e33e-89a0-49e2-87ec-8b51e69e6f30 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:01.925681 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61ef49-74ba-475a-9195-fc45858366c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:01.926659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61ef49-74ba-475a-9195-fc45858366c5 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:01.927146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61ef49-74ba-475a-9195-fc45858366c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:01.927750 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61ef49-74ba-475a-9195-fc45858366c5 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:01.928669 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61ef49-74ba-475a-9195-fc45858366c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:01.929244 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61ef49-74ba-475a-9195-fc45858366c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:01.930870 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61ef49-74ba-475a-9195-fc45858366c5 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:01.943948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 269/537] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:01.949711 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659c87c-4e15-46d0-b4cc-200b1ffcd65c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.022015 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:02.063522 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659c87c-4e15-46d0-b4cc-200b1ffcd65c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:02.099920 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dad91-1785-47de-b573-f9c5b0fe57f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:02.100598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dad91-1785-47de-b573-f9c5b0fe57f9 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.100880 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dad91-1785-47de-b573-f9c5b0fe57f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.101156 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dad91-1785-47de-b573-f9c5b0fe57f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.109153 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dad91-1785-47de-b573-f9c5b0fe57f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:02.110640 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dad91-1785-47de-b573-f9c5b0fe57f9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-ac8dad91-1785-47de-b573-f9c5b0fe57f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:02.122429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:02.123860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:02.124790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 269/538] 10.222.0.100 () {56 vars in 1098 bytes} [Tue Jul 26 15:12:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:02.130793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61ef49-74ba-475a-9195-fc45858366c5 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.149398 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:02.180524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00a589-a81c-4e95-8adc-31a71cfe08ac None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.180833 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00a589-a81c-4e95-8adc-31a71cfe08ac None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.181080 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00a589-a81c-4e95-8adc-31a71cfe08ac None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.182669 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 270/539] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:02.187575 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8866f-0500-4df2-8f54-2dd97ed1168a None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.187864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8866f-0500-4df2-8f54-2dd97ed1168a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.188172 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8866f-0500-4df2-8f54-2dd97ed1168a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.207832 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-8bc8866f-0500-4df2-8f54-2dd97ed1168a None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:02.209315 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-8bc8866f-0500-4df2-8f54-2dd97ed1168a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:02.245338 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61ef49-74ba-475a-9195-fc45858366c5 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:02.280546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b007fa-c5d3-469d-83fe-5bd21cd8df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:02.281087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b007fa-c5d3-469d-83fe-5bd21cd8df38 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.281370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b007fa-c5d3-469d-83fe-5bd21cd8df38 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.281647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b007fa-c5d3-469d-83fe-5bd21cd8df38 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.282450 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b007fa-c5d3-469d-83fe-5bd21cd8df38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:02.282759 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b007fa-c5d3-469d-83fe-5bd21cd8df38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:02.284786 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b007fa-c5d3-469d-83fe-5bd21cd8df38 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:02.288439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 271/540] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:02.303834 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 270/541] 10.222.0.100 () {56 vars in 1138 bytes} [Tue Jul 26 15:12:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:02.305598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8866f-0500-4df2-8f54-2dd97ed1168a None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.309042 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b007fa-c5d3-469d-83fe-5bd21cd8df38 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.368018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:02.400569 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:02.417133 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8866f-0500-4df2-8f54-2dd97ed1168a None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:02.417625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b007fa-c5d3-469d-83fe-5bd21cd8df38 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:02.454095 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e18fcd-d600-4476-8d80-fb47714268b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:02.454983 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e18fcd-d600-4476-8d80-fb47714268b8 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.455100 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c1f50-b0d4-46d8-9226-c664f16d99f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:02.455549 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e18fcd-d600-4476-8d80-fb47714268b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.455731 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1f50-b0d4-46d8-9226-c664f16d99f5 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.456018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1f50-b0d4-46d8-9226-c664f16d99f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.456344 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c1f50-b0d4-46d8-9226-c664f16d99f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.456480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e18fcd-d600-4476-8d80-fb47714268b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.467496 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c1f50-b0d4-46d8-9226-c664f16d99f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:02.467679 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e18fcd-d600-4476-8d80-fb47714268b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:02.470182 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c1f50-b0d4-46d8-9226-c664f16d99f5 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-b7e18fcd-d600-4476-8d80-fb47714268b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:02.473541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:02.474603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:02.475587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:02.482354 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 272/542] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f65c1f50-b0d4-46d8-9226-c664f16d99f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:02.487643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:02.488725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:02.489667 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:02.489667 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:02.489667 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:02.489667 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:02.492222 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 271/543] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:02.493003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e18fcd-d600-4476-8d80-fb47714268b8 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.494225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c1f50-b0d4-46d8-9226-c664f16d99f5 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.602559 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e18fcd-d600-4476-8d80-fb47714268b8 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:02.614060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c1f50-b0d4-46d8-9226-c664f16d99f5 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:02.624848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:02.640419 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:02.643981 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4eaf5a-d569-4526-b1bf-cb7697d60339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:02.644638 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eaf5a-d569-4526-b1bf-cb7697d60339 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.644919 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eaf5a-d569-4526-b1bf-cb7697d60339 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.645365 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4eaf5a-d569-4526-b1bf-cb7697d60339 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.645898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4eaf5a-d569-4526-b1bf-cb7697d60339 None admin] RBAC: Adding query filter params (name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:02.646200 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4eaf5a-d569-4526-b1bf-cb7697d60339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:02.647586 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4eaf5a-d569-4526-b1bf-cb7697d60339 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:02.652969 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fc5dc-24c7-41b2-977b-482783f2429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:02.653592 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fc5dc-24c7-41b2-977b-482783f2429c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.653878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fc5dc-24c7-41b2-977b-482783f2429c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.654154 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fc5dc-24c7-41b2-977b-482783f2429c None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.654843 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fc5dc-24c7-41b2-977b-482783f2429c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:02.655150 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fc5dc-24c7-41b2-977b-482783f2429c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:02.661441 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 273/544] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:12:02 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:02.661586 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fc5dc-24c7-41b2-977b-482783f2429c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:02.661662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383984-ffc2-4eb0-9f10-00110a44e78e None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.661662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383984-ffc2-4eb0-9f10-00110a44e78e None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.661662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383984-ffc2-4eb0-9f10-00110a44e78e None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.661662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 274/545] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:02.662225 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383984-ffc2-4eb0-9f10-00110a44e78e None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.679270 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 272/546] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:02.680632 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef680d-2738-4a06-8159-e14a043e386e None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.680933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef680d-2738-4a06-8159-e14a043e386e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.681205 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef680d-2738-4a06-8159-e14a043e386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.700072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-7bef680d-2738-4a06-8159-e14a043e386e None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:02.701314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-7bef680d-2738-4a06-8159-e14a043e386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:02.771613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 273/547] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:02.771613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef680d-2738-4a06-8159-e14a043e386e None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.784462 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383984-ffc2-4eb0-9f10-00110a44e78e None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:02.815040 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feb2ec-c210-4f69-a4bf-2f40f0a19651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:02.815680 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feb2ec-c210-4f69-a4bf-2f40f0a19651 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.815965 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feb2ec-c210-4f69-a4bf-2f40f0a19651 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.816279 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feb2ec-c210-4f69-a4bf-2f40f0a19651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.826826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87feb2ec-c210-4f69-a4bf-2f40f0a19651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:02.828268 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87feb2ec-c210-4f69-a4bf-2f40f0a19651 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-87feb2ec-c210-4f69-a4bf-2f40f0a19651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:02.842788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:02.843633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:02.844515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:02.844515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:02.844515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:02.844515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:02.844515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 275/548] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:02.845224 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6329503-8c97-499f-a2aa-531570831f0e None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.845455 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6329503-8c97-499f-a2aa-531570831f0e None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.845728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6329503-8c97-499f-a2aa-531570831f0e None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.847551 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 276/549] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:02.848281 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6329503-8c97-499f-a2aa-531570831f0e None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.878508 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef680d-2738-4a06-8159-e14a043e386e None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:02.879710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:02.891700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:02.913295 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a5a56-a158-4f84-9bf0-2adb49edb5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:02.913941 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a5a56-a158-4f84-9bf0-2adb49edb5af None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.914225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a5a56-a158-4f84-9bf0-2adb49edb5af None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.914497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a5a56-a158-4f84-9bf0-2adb49edb5af None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:02.922005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a5a56-a158-4f84-9bf0-2adb49edb5af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:02.923501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a5a56-a158-4f84-9bf0-2adb49edb5af None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-0c4a5a56-a158-4f84-9bf0-2adb49edb5af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:02.936783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:02.938223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:02.939341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:02.939341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:02.939341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:02.939341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:02.939341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:02.939341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:02.939341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:02.939341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:02.940282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 274/550] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:02.940629 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a5a56-a158-4f84-9bf0-2adb49edb5af None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:02.962165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6329503-8c97-499f-a2aa-531570831f0e None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:02.996901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a455bb0-743f-4112-ac8e-56cc0b3f7920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:02.997543 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455bb0-743f-4112-ac8e-56cc0b3f7920 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:02.997827 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455bb0-743f-4112-ac8e-56cc0b3f7920 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:02.998108 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455bb0-743f-4112-ac8e-56cc0b3f7920 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.008207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a455bb0-743f-4112-ac8e-56cc0b3f7920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-7a455bb0-743f-4112-ac8e-56cc0b3f7920 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:03.013159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:03.014251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 277/551] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:12:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:03.015439 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a444403-3711-4d2f-8f88-2a3aec2edcaf None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.016356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a444403-3711-4d2f-8f88-2a3aec2edcaf None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.016356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a444403-3711-4d2f-8f88-2a3aec2edcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.035192 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-3a444403-3711-4d2f-8f88-2a3aec2edcaf None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:03.036418 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-3a444403-3711-4d2f-8f88-2a3aec2edcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:03.043354 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a5a56-a158-4f84-9bf0-2adb49edb5af None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.075744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebe8c8-2fed-4c47-888d-51febc7af4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.076508 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebe8c8-2fed-4c47-888d-51febc7af4b2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.076857 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebe8c8-2fed-4c47-888d-51febc7af4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.076960 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebe8c8-2fed-4c47-888d-51febc7af4b2 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.077622 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebe8c8-2fed-4c47-888d-51febc7af4b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:03.077928 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebe8c8-2fed-4c47-888d-51febc7af4b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.079309 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebe8c8-2fed-4c47-888d-51febc7af4b2 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.091461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 275/552] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:03.092320 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebe8c8-2fed-4c47-888d-51febc7af4b2 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.124156 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 278/553] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:03.124156 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a444403-3711-4d2f-8f88-2a3aec2edcaf None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.128337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.139293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.198473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebe8c8-2fed-4c47-888d-51febc7af4b2 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.216199 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a444403-3711-4d2f-8f88-2a3aec2edcaf None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.244109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374f305-d207-4a50-9edd-d49061fb3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.244751 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374f305-d207-4a50-9edd-d49061fb3160 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.245036 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374f305-d207-4a50-9edd-d49061fb3160 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.245320 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374f305-d207-4a50-9edd-d49061fb3160 None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.246066 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374f305-d207-4a50-9edd-d49061fb3160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:03.246372 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374f305-d207-4a50-9edd-d49061fb3160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.247806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374f305-d207-4a50-9edd-d49061fb3160 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.259363 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14afc6-9083-4202-b479-d735c2447561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.260042 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 276/554] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:03.260200 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14afc6-9083-4202-b479-d735c2447561 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.260312 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14afc6-9083-4202-b479-d735c2447561 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.260582 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14afc6-9083-4202-b479-d735c2447561 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.261056 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374f305-d207-4a50-9edd-d49061fb3160 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.261299 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14afc6-9083-4202-b479-d735c2447561 None admin] RBAC: Adding query filter params (name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:03.261607 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14afc6-9083-4202-b479-d735c2447561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.262998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14afc6-9083-4202-b479-d735c2447561 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.272014 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 279/555] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:12:03 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:03.272864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14afc6-9083-4202-b479-d735c2447561 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.352625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.358238 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.361572 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374f305-d207-4a50-9edd-d49061fb3160 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.377086 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14afc6-9083-4202-b479-d735c2447561 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.399099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfee94-d859-45f8-839c-27d7c9b1af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.399652 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfee94-d859-45f8-839c-27d7c9b1af2b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.399929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfee94-d859-45f8-839c-27d7c9b1af2b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.400229 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfee94-d859-45f8-839c-27d7c9b1af2b None admin] PATH_INFO: `/v3/users/glance` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.409218 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfee94-d859-45f8-839c-27d7c9b1af2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.410690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfee94-d859-45f8-839c-27d7c9b1af2b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.411542 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a01ea0-520d-4a8d-828b-3f031dcfaf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.412225 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a01ea0-520d-4a8d-828b-3f031dcfaf55 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.412515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a01ea0-520d-4a8d-828b-3f031dcfaf55 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.412792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a01ea0-520d-4a8d-828b-3f031dcfaf55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f0bfee94-d859-45f8-839c-27d7c9b1af2b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:03.422109 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:03.423250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 277/556] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:12:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:03.425084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfee94-d859-45f8-839c-27d7c9b1af2b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.427253 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a01ea0-520d-4a8d-828b-3f031dcfaf55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-c3a01ea0-520d-4a8d-828b-3f031dcfaf55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:03.433666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:03.434624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 280/557] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:03.440398 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a01ea0-520d-4a8d-828b-3f031dcfaf55 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.526350 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfee94-d859-45f8-839c-27d7c9b1af2b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.539228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a01ea0-520d-4a8d-828b-3f031dcfaf55 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.560438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c707824-b155-4302-b40d-a101be8d5af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.561152 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c707824-b155-4302-b40d-a101be8d5af0 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.561389 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c707824-b155-4302-b40d-a101be8d5af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.561668 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c707824-b155-4302-b40d-a101be8d5af0 None admin] PATH_INFO: `/v3/projects/7bc4375bb14d42199565b224bef1242c/users/dcc3cee241bd45c49e37124cc4dd6e34/roles/58cdb402595a4191aa19b0b3a4ad8827` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.574668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8973-0b9e-43df-8410-7015f899a360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.575470 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8973-0b9e-43df-8410-7015f899a360 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.575749 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8973-0b9e-43df-8410-7015f899a360 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.576024 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8973-0b9e-43df-8410-7015f899a360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.578471 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c707824-b155-4302-b40d-a101be8d5af0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4375bb14d42199565b224bef1242c, user_id=dcc3cee241bd45c49e37124cc4dd6e34, role_id=58cdb402595a4191aa19b0b3a4ad8827)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.579940 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c707824-b155-4302-b40d-a101be8d5af0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.587734 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd8973-0b9e-43df-8410-7015f899a360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.589267 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd8973-0b9e-43df-8410-7015f899a360 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.591182 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-24cd8973-0b9e-43df-8410-7015f899a360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:03.612303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:03.613689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:03.614577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:03.614577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:03.614577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:03.614577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:03.614577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 281/558] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:03.614577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8973-0b9e-43df-8410-7015f899a360 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.640895 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 278/559] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:12:03 2022] PUT /identity/v3/projects/7bc4375bb14d42199565b224bef1242c/users/dcc3cee241bd45c49e37124cc4dd6e34/roles/58cdb402595a4191aa19b0b3a4ad8827 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:12:03.641752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c707824-b155-4302-b40d-a101be8d5af0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.654371 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.752301 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8973-0b9e-43df-8410-7015f899a360 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.788480 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c707824-b155-4302-b40d-a101be8d5af0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.793245 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae7b0-cf06-4239-8e79-0eef81a425f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.793930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae7b0-cf06-4239-8e79-0eef81a425f6 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.794217 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae7b0-cf06-4239-8e79-0eef81a425f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.794493 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae7b0-cf06-4239-8e79-0eef81a425f6 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.795301 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae7b0-cf06-4239-8e79-0eef81a425f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:03.795611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae7b0-cf06-4239-8e79-0eef81a425f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.797202 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcae7b0-cf06-4239-8e79-0eef81a425f6 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.820952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 282/560] 10.222.0.100 () {56 vars in 1142 bytes} [Tue Jul 26 15:12:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:03.822094 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae7b0-cf06-4239-8e79-0eef81a425f6 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.829777 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d69630-42d8-4258-85f9-f0e8f395aba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.830925 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d69630-42d8-4258-85f9-f0e8f395aba5 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.831220 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d69630-42d8-4258-85f9-f0e8f395aba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.831501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d69630-42d8-4258-85f9-f0e8f395aba5 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.832256 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d69630-42d8-4258-85f9-f0e8f395aba5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:03.832561 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d69630-42d8-4258-85f9-f0e8f395aba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.833933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d69630-42d8-4258-85f9-f0e8f395aba5 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.843026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 279/561] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:12:03 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:03.843763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d69630-42d8-4258-85f9-f0e8f395aba5 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:03.883916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.912531 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:03.938332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae7b0-cf06-4239-8e79-0eef81a425f6 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.953596 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d69630-42d8-4258-85f9-f0e8f395aba5 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:03.982732 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00a059-bea4-4b2d-9850-7bb472fdf131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:03.983774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00a059-bea4-4b2d-9850-7bb472fdf131 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:03.984328 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00a059-bea4-4b2d-9850-7bb472fdf131 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:03.984831 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00a059-bea4-4b2d-9850-7bb472fdf131 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:03.985650 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00a059-bea4-4b2d-9850-7bb472fdf131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:03.985961 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00a059-bea4-4b2d-9850-7bb472fdf131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:03.987662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00a059-bea4-4b2d-9850-7bb472fdf131 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:03.999255 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298054b2-0032-4a7d-9328-2bc41de19cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.006656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 283/562] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:04.006656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00a059-bea4-4b2d-9850-7bb472fdf131 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.008526 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298054b2-0032-4a7d-9328-2bc41de19cd6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.008814 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298054b2-0032-4a7d-9328-2bc41de19cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.009107 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298054b2-0032-4a7d-9328-2bc41de19cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.021861 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298054b2-0032-4a7d-9328-2bc41de19cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.023313 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298054b2-0032-4a7d-9328-2bc41de19cd6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-298054b2-0032-4a7d-9328-2bc41de19cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:04.047116 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:04.050087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:04.051174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:04.051174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:04.051174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:04.051174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:04.051174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 280/563] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:04.051174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298054b2-0032-4a7d-9328-2bc41de19cd6 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.134392 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00a059-bea4-4b2d-9850-7bb472fdf131 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.154397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:04.169301 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298054b2-0032-4a7d-9328-2bc41de19cd6 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.178972 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9ca14-ea6f-4be0-8dcc-4b31e84ea8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.180202 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9ca14-ea6f-4be0-8dcc-4b31e84ea8e9 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.180424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9ca14-ea6f-4be0-8dcc-4b31e84ea8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.180709 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9ca14-ea6f-4be0-8dcc-4b31e84ea8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.187506 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:04.192492 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9ca14-ea6f-4be0-8dcc-4b31e84ea8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.194372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9ca14-ea6f-4be0-8dcc-4b31e84ea8e9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.207036 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b375124-b86f-4d80-a997-55cb1ae66770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.207746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b375124-b86f-4d80-a997-55cb1ae66770 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.208035 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b375124-b86f-4d80-a997-55cb1ae66770 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.208491 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b375124-b86f-4d80-a997-55cb1ae66770 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-5ba9ca14-ea6f-4be0-8dcc-4b31e84ea8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:04.210620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:04.211476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:04.212846 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:04.212846 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:04.212846 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:04.212846 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:04.212846 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 284/564] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:04.212846 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9ca14-ea6f-4be0-8dcc-4b31e84ea8e9 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.223422 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b375124-b86f-4d80-a997-55cb1ae66770 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.224926 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b375124-b86f-4d80-a997-55cb1ae66770 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-2b375124-b86f-4d80-a997-55cb1ae66770 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:04.237497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:04.238519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:04.239479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 281/565] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:04.240097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b375124-b86f-4d80-a997-55cb1ae66770 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.350860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9ca14-ea6f-4be0-8dcc-4b31e84ea8e9 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.363609 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b375124-b86f-4d80-a997-55cb1ae66770 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.390821 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03987821-58cd-4e8d-852e-05944be30b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.391537 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03987821-58cd-4e8d-852e-05944be30b44 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.391820 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03987821-58cd-4e8d-852e-05944be30b44 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.392106 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03987821-58cd-4e8d-852e-05944be30b44 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.393177 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03987821-58cd-4e8d-852e-05944be30b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:04.393485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03987821-58cd-4e8d-852e-05944be30b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.394877 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03987821-58cd-4e8d-852e-05944be30b44 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.409158 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 285/566] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:04.409799 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03987821-58cd-4e8d-852e-05944be30b44 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.414822 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c6160-5285-4b81-99e1-74bb2856ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.415551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c6160-5285-4b81-99e1-74bb2856ffc9 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.416221 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c6160-5285-4b81-99e1-74bb2856ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.416597 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c6160-5285-4b81-99e1-74bb2856ffc9 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.417400 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c6160-5285-4b81-99e1-74bb2856ffc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:04.417823 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c6160-5285-4b81-99e1-74bb2856ffc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.419413 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c6160-5285-4b81-99e1-74bb2856ffc9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.441627 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 282/567] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:04.442836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c6160-5285-4b81-99e1-74bb2856ffc9 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.447454 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:04.484663 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:04.526608 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03987821-58cd-4e8d-852e-05944be30b44 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.557684 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c6160-5285-4b81-99e1-74bb2856ffc9 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.560974 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1d441-e9f8-4d75-877d-4dae06c6ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.561595 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1d441-e9f8-4d75-877d-4dae06c6ae80 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.561877 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1d441-e9f8-4d75-877d-4dae06c6ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.562155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1d441-e9f8-4d75-877d-4dae06c6ae80 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.562950 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1d441-e9f8-4d75-877d-4dae06c6ae80 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:04.563261 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1d441-e9f8-4d75-877d-4dae06c6ae80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.564764 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1d441-e9f8-4d75-877d-4dae06c6ae80 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.586695 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 286/568] 10.222.0.100 () {56 vars in 1142 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:04.586695 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1d441-e9f8-4d75-877d-4dae06c6ae80 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.599843 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4a3a6-c0bb-4efb-8877-ecc88ff90740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.600720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4a3a6-c0bb-4efb-8877-ecc88ff90740 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.601143 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4a3a6-c0bb-4efb-8877-ecc88ff90740 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.601674 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4a3a6-c0bb-4efb-8877-ecc88ff90740 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.609110 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4a3a6-c0bb-4efb-8877-ecc88ff90740 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.610534 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4a3a6-c0bb-4efb-8877-ecc88ff90740 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-51a4a3a6-c0bb-4efb-8877-ecc88ff90740 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:04.622378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:04.623306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:04.624269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:04.624269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:04.624269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:04.624269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:04.624269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:04.624269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:04.624269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:04.624269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:04.624269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 283/569] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:04.624773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4a3a6-c0bb-4efb-8877-ecc88ff90740 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.682770 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:04.701254 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1d441-e9f8-4d75-877d-4dae06c6ae80 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.736254 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:04.740692 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d64a0-8c3e-4a68-bcf2-9476b2fd7662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.741360 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d64a0-8c3e-4a68-bcf2-9476b2fd7662 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.741644 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d64a0-8c3e-4a68-bcf2-9476b2fd7662 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.741973 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d64a0-8c3e-4a68-bcf2-9476b2fd7662 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.742636 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4a3a6-c0bb-4efb-8877-ecc88ff90740 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.749516 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d64a0-8c3e-4a68-bcf2-9476b2fd7662 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.751108 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d64a0-8c3e-4a68-bcf2-9476b2fd7662 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-694d64a0-8c3e-4a68-bcf2-9476b2fd7662 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:04.763178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:04.764480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:04.765631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 287/570] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:04.766504 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d64a0-8c3e-4a68-bcf2-9476b2fd7662 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.789693 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88040df-82e4-4e5c-9de1-e6c0aced6d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.790329 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88040df-82e4-4e5c-9de1-e6c0aced6d1d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.790613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88040df-82e4-4e5c-9de1-e6c0aced6d1d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.791148 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88040df-82e4-4e5c-9de1-e6c0aced6d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.802809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88040df-82e4-4e5c-9de1-e6c0aced6d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.804878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88040df-82e4-4e5c-9de1-e6c0aced6d1d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-b88040df-82e4-4e5c-9de1-e6c0aced6d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:04.825131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:04.828279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:04.829185 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:04.829185 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:04.829185 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:04.829185 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:04.829185 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 284/571] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:04.829185 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88040df-82e4-4e5c-9de1-e6c0aced6d1d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.886228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d64a0-8c3e-4a68-bcf2-9476b2fd7662 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.922696 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e737223-7fa6-40f1-b233-1321f60075df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.923436 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e737223-7fa6-40f1-b233-1321f60075df None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.923718 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e737223-7fa6-40f1-b233-1321f60075df None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.924141 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e737223-7fa6-40f1-b233-1321f60075df None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.924949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e737223-7fa6-40f1-b233-1321f60075df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:04.925381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e737223-7fa6-40f1-b233-1321f60075df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.926820 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e737223-7fa6-40f1-b233-1321f60075df None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:04.944590 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 288/572] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:04.944590 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e737223-7fa6-40f1-b233-1321f60075df None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:04.944590 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:04.949627 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88040df-82e4-4e5c-9de1-e6c0aced6d1d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:04.989161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895a0d0-4f4c-4b2a-abc3-0c26a0361b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:04.989788 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895a0d0-4f4c-4b2a-abc3-0c26a0361b69 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:04.990391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895a0d0-4f4c-4b2a-abc3-0c26a0361b69 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:04.990678 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895a0d0-4f4c-4b2a-abc3-0c26a0361b69 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:04.991638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895a0d0-4f4c-4b2a-abc3-0c26a0361b69 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:04.991949 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895a0d0-4f4c-4b2a-abc3-0c26a0361b69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:04.993429 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895a0d0-4f4c-4b2a-abc3-0c26a0361b69 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:05.012391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 285/573] 10.222.0.100 () {56 vars in 1144 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:05.013307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895a0d0-4f4c-4b2a-abc3-0c26a0361b69 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:05.023211 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:05.062490 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e737223-7fa6-40f1-b233-1321f60075df None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:05.102505 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99039d-1409-4d8c-bce6-49c79b811e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:05.103124 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99039d-1409-4d8c-bce6-49c79b811e81 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:05.103405 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99039d-1409-4d8c-bce6-49c79b811e81 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:05.103684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99039d-1409-4d8c-bce6-49c79b811e81 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:05.104403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99039d-1409-4d8c-bce6-49c79b811e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:05.104701 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99039d-1409-4d8c-bce6-49c79b811e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:05.106074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99039d-1409-4d8c-bce6-49c79b811e81 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:05.118258 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 289/574] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:05.119062 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99039d-1409-4d8c-bce6-49c79b811e81 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:05.125121 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895a0d0-4f4c-4b2a-abc3-0c26a0361b69 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:05.161982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14f84b-f1e6-4bbd-bbcd-d204c1d09ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:05.162648 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f84b-f1e6-4bbd-bbcd-d204c1d09ecc None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:05.162934 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f84b-f1e6-4bbd-bbcd-d204c1d09ecc None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:05.163209 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14f84b-f1e6-4bbd-bbcd-d204c1d09ecc None admin] PATH_INFO: `/v3/projects/7bc4375bb14d42199565b224bef1242c/users/4f62b11cb0dc462caeacfdba8cd45658/roles/58cdb402595a4191aa19b0b3a4ad8827` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:05.178622 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14f84b-f1e6-4bbd-bbcd-d204c1d09ecc None admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4375bb14d42199565b224bef1242c, user_id=4f62b11cb0dc462caeacfdba8cd45658, role_id=58cdb402595a4191aa19b0b3a4ad8827)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:05.180443 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14f84b-f1e6-4bbd-bbcd-d204c1d09ecc None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:05.185329 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:05.223473 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99039d-1409-4d8c-bce6-49c79b811e81 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:05.258034 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 286/575] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:12:05 2022] PUT /identity/v3/projects/7bc4375bb14d42199565b224bef1242c/users/4f62b11cb0dc462caeacfdba8cd45658/roles/58cdb402595a4191aa19b0b3a4ad8827 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:12:05.258567 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce2bce-c7b9-480b-812c-bcb95a72e1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:05.258964 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce2bce-c7b9-480b-812c-bcb95a72e1db None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:05.259356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce2bce-c7b9-480b-812c-bcb95a72e1db None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:05.259643 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce2bce-c7b9-480b-812c-bcb95a72e1db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:05.260473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14f84b-f1e6-4bbd-bbcd-d204c1d09ecc None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:05.280595 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce2bce-c7b9-480b-812c-bcb95a72e1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:05.284755 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce2bce-c7b9-480b-812c-bcb95a72e1db None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-08ce2bce-c7b9-480b-812c-bcb95a72e1db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:05.306222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:05.307381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:05.308497 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:05.308497 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:05.308497 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:05.308497 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:05.314915 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 290/576] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:05.316850 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce2bce-c7b9-480b-812c-bcb95a72e1db None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:05.342693 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:05.393460 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14f84b-f1e6-4bbd-bbcd-d204c1d09ecc None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:05.433845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7164ea-ed3c-43f6-b9b0-37da2b069807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:05.434534 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7164ea-ed3c-43f6-b9b0-37da2b069807 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:05.434817 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7164ea-ed3c-43f6-b9b0-37da2b069807 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:05.435090 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7164ea-ed3c-43f6-b9b0-37da2b069807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:05.444628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7164ea-ed3c-43f6-b9b0-37da2b069807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:05.446244 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7164ea-ed3c-43f6-b9b0-37da2b069807 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:05.452832 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce2bce-c7b9-480b-812c-bcb95a72e1db None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-9b7164ea-ed3c-43f6-b9b0-37da2b069807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:05.462619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:05.463546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:05.464549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:05.464549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:05.464549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:05.464549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:05.464549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:05.464549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:05.464549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:05.464549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:05.464549 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 287/577] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:05.474866 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7164ea-ed3c-43f6-b9b0-37da2b069807 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:05.475262 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:05.493395 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32e3f3-c487-41ca-b2bc-0b2886ef6447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:05.494029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32e3f3-c487-41ca-b2bc-0b2886ef6447 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:05.494317 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32e3f3-c487-41ca-b2bc-0b2886ef6447 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:05.494598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32e3f3-c487-41ca-b2bc-0b2886ef6447 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:05.495299 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32e3f3-c487-41ca-b2bc-0b2886ef6447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:05.495603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32e3f3-c487-41ca-b2bc-0b2886ef6447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:05.498923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32e3f3-c487-41ca-b2bc-0b2886ef6447 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:05.517102 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 291/578] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:05.522918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32e3f3-c487-41ca-b2bc-0b2886ef6447 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:05.617353 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7164ea-ed3c-43f6-b9b0-37da2b069807 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:05.635934 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:05.649034 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32e3f3-c487-41ca-b2bc-0b2886ef6447 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:05.656580 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b4973-8c0c-4f90-8ea9-258e771a014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:05.657424 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b4973-8c0c-4f90-8ea9-258e771a014b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:05.657848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b4973-8c0c-4f90-8ea9-258e771a014b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:05.658361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b4973-8c0c-4f90-8ea9-258e771a014b None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:05.659325 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b4973-8c0c-4f90-8ea9-258e771a014b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:05.659829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b4973-8c0c-4f90-8ea9-258e771a014b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:05.661555 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b4973-8c0c-4f90-8ea9-258e771a014b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:05.676181 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 288/579] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:05.681446 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b4973-8c0c-4f90-8ea9-258e771a014b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:05.693895 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b2753-aa90-4064-8dce-bb07aab398b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:05.695328 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b2753-aa90-4064-8dce-bb07aab398b5 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:05.696081 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b2753-aa90-4064-8dce-bb07aab398b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:05.696604 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b2753-aa90-4064-8dce-bb07aab398b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:05.706762 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b2753-aa90-4064-8dce-bb07aab398b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:05.709019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b2753-aa90-4064-8dce-bb07aab398b5 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-fa6b2753-aa90-4064-8dce-bb07aab398b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:05.727330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:05.728412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:05.729600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:05.729600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:05.729600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:05.729600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:05.729600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:05.729600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:05.729600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:05.729600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:05.732346 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 292/580] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:05.737752 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b2753-aa90-4064-8dce-bb07aab398b5 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:05.796154 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:05.800660 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b4973-8c0c-4f90-8ea9-258e771a014b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:05.839955 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d723c-aa99-4c26-96d2-d9e259b698c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:05.841080 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d723c-aa99-4c26-96d2-d9e259b698c0 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:05.841571 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d723c-aa99-4c26-96d2-d9e259b698c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:05.842103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d723c-aa99-4c26-96d2-d9e259b698c0 None admin] PATH_INFO: `/v3/projects/7bc4375bb14d42199565b224bef1242c/users/c5e22a12ebdd493c8c14cfaf2dfc1af2/roles/58cdb402595a4191aa19b0b3a4ad8827` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:05.858925 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d723c-aa99-4c26-96d2-d9e259b698c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4375bb14d42199565b224bef1242c, user_id=c5e22a12ebdd493c8c14cfaf2dfc1af2, role_id=58cdb402595a4191aa19b0b3a4ad8827)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:05.860757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d723c-aa99-4c26-96d2-d9e259b698c0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:05.886545 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b2753-aa90-4064-8dce-bb07aab398b5 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:05.925025 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2676b-a6c0-4c47-bb6d-125ee32689a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:05.925696 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2676b-a6c0-4c47-bb6d-125ee32689a0 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:05.926004 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2676b-a6c0-4c47-bb6d-125ee32689a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:05.926259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2676b-a6c0-4c47-bb6d-125ee32689a0 None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:05.927018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2676b-a6c0-4c47-bb6d-125ee32689a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:05.927322 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2676b-a6c0-4c47-bb6d-125ee32689a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:05.928791 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2676b-a6c0-4c47-bb6d-125ee32689a0 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:05.941773 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 293/581] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:05.947379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2676b-a6c0-4c47-bb6d-125ee32689a0 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:06.018780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 289/582] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:12:05 2022] PUT /identity/v3/projects/7bc4375bb14d42199565b224bef1242c/users/c5e22a12ebdd493c8c14cfaf2dfc1af2/roles/58cdb402595a4191aa19b0b3a4ad8827 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:12:06.018780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5f85-d704-49a4-81bd-006b0db83562 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:06.018780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5f85-d704-49a4-81bd-006b0db83562 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:06.018780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd5f85-d704-49a4-81bd-006b0db83562 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:06.018780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 290/583] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:06.023187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf41df-a430-46b9-a332-89ad8e50d216 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:06.023509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf41df-a430-46b9-a332-89ad8e50d216 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:06.023741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf41df-a430-46b9-a332-89ad8e50d216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:06.042763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c6bf41df-a430-46b9-a332-89ad8e50d216 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:06.043984 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c6bf41df-a430-46b9-a332-89ad8e50d216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:06.057023 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:06.063336 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2676b-a6c0-4c47-bb6d-125ee32689a0 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:06.071031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:06.109144 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4204e1-a30b-4475-b4b3-58fbe2b19f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:06.110032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4204e1-a30b-4475-b4b3-58fbe2b19f1d None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:06.110314 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4204e1-a30b-4475-b4b3-58fbe2b19f1d None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:06.110594 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4204e1-a30b-4475-b4b3-58fbe2b19f1d None admin] PATH_INFO: `/v3/projects/7bc4375bb14d42199565b224bef1242c/users/50361b26fc1441ea9e78b3f59f1e4f8f/roles/58cdb402595a4191aa19b0b3a4ad8827` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:06.133881 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4204e1-a30b-4475-b4b3-58fbe2b19f1d None admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4375bb14d42199565b224bef1242c, user_id=50361b26fc1441ea9e78b3f59f1e4f8f, role_id=58cdb402595a4191aa19b0b3a4ad8827)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:06.135413 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4204e1-a30b-4475-b4b3-58fbe2b19f1d None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:06.144425 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 291/584] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:12:06.163831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf41df-a430-46b9-a332-89ad8e50d216 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:06.237325 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 294/585] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:12:05 2022] PUT /identity/v3/projects/7bc4375bb14d42199565b224bef1242c/users/50361b26fc1441ea9e78b3f59f1e4f8f/roles/58cdb402595a4191aa19b0b3a4ad8827 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:12:06.306453 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf41df-a430-46b9-a332-89ad8e50d216 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:06.345396 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538960f5-1d3c-449b-975e-afb60d03c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:06.346925 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538960f5-1d3c-449b-975e-afb60d03c38d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:06.347356 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538960f5-1d3c-449b-975e-afb60d03c38d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:06.347811 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538960f5-1d3c-449b-975e-afb60d03c38d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:06.359902 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538960f5-1d3c-449b-975e-afb60d03c38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-538960f5-1d3c-449b-975e-afb60d03c38d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:06.365741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:06.366899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:06.367930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:06.370402 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 292/586] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:06.376640 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4204e1-a30b-4475-b4b3-58fbe2b19f1d None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:06.490345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4204e1-a30b-4475-b4b3-58fbe2b19f1d None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:06.532716 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ebb0a-08c2-4fb7-8771-fa4c455d6742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:06.533334 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ebb0a-08c2-4fb7-8771-fa4c455d6742 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:06.533656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ebb0a-08c2-4fb7-8771-fa4c455d6742 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:06.533930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ebb0a-08c2-4fb7-8771-fa4c455d6742 None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:06.534780 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ebb0a-08c2-4fb7-8771-fa4c455d6742 None admin] RBAC: Adding query filter params (name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:06.535087 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ebb0a-08c2-4fb7-8771-fa4c455d6742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:06.536475 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ebb0a-08c2-4fb7-8771-fa4c455d6742 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:06.546147 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 295/587] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:12:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:06.553387 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538960f5-1d3c-449b-975e-afb60d03c38d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:06.573852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:06.661775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538960f5-1d3c-449b-975e-afb60d03c38d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:06.695866 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fa779-0dd0-4096-8d8a-5f5de7601f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:06.696590 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa779-0dd0-4096-8d8a-5f5de7601f35 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:06.696872 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa779-0dd0-4096-8d8a-5f5de7601f35 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:06.697149 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fa779-0dd0-4096-8d8a-5f5de7601f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:06.708000 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fa779-0dd0-4096-8d8a-5f5de7601f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:06.709564 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fa779-0dd0-4096-8d8a-5f5de7601f35 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-7d9fa779-0dd0-4096-8d8a-5f5de7601f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:06.724980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:06.725916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:06.727263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:06.727263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:06.727263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:06.727263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:06.727263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 293/588] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:06.731920 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ebb0a-08c2-4fb7-8771-fa4c455d6742 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:06.742912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:06.839456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ebb0a-08c2-4fb7-8771-fa4c455d6742 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:06.875708 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba25a-d860-47d6-8e46-970bd011e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:06.876357 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba25a-d860-47d6-8e46-970bd011e9f1 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:06.876643 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba25a-d860-47d6-8e46-970bd011e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:06.876921 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cba25a-d860-47d6-8e46-970bd011e9f1 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:06.878200 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cba25a-d860-47d6-8e46-970bd011e9f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:06.878507 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cba25a-d860-47d6-8e46-970bd011e9f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:06.879896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cba25a-d860-47d6-8e46-970bd011e9f1 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:06.893083 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 296/589] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:06.898447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fa779-0dd0-4096-8d8a-5f5de7601f35 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:06.972487 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:07.002562 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fa779-0dd0-4096-8d8a-5f5de7601f35 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:07.036702 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e97199-a972-4953-8b74-60388c2a1396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:07.037339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e97199-a972-4953-8b74-60388c2a1396 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.037621 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e97199-a972-4953-8b74-60388c2a1396 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.037900 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e97199-a972-4953-8b74-60388c2a1396 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.045998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e97199-a972-4953-8b74-60388c2a1396 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:07.047603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e97199-a972-4953-8b74-60388c2a1396 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-77e97199-a972-4953-8b74-60388c2a1396 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:07.060087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:07.062760 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:07.063726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 294/590] 10.222.0.100 () {56 vars in 1098 bytes} [Tue Jul 26 15:12:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:07.067357 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba25a-d860-47d6-8e46-970bd011e9f1 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:07.136863 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:07.172573 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cba25a-d860-47d6-8e46-970bd011e9f1 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:07.208049 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d40b6-36dd-4eec-8eae-314e32492e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:07.208699 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d40b6-36dd-4eec-8eae-314e32492e15 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.208980 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d40b6-36dd-4eec-8eae-314e32492e15 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.209256 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d40b6-36dd-4eec-8eae-314e32492e15 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.210047 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d40b6-36dd-4eec-8eae-314e32492e15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:07.210351 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d40b6-36dd-4eec-8eae-314e32492e15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:07.211796 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d40b6-36dd-4eec-8eae-314e32492e15 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:07.230496 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 297/591] 10.222.0.100 () {56 vars in 1138 bytes} [Tue Jul 26 15:12:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:07.236309 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e97199-a972-4953-8b74-60388c2a1396 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:07.349765 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e97199-a972-4953-8b74-60388c2a1396 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:07.377726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:07.386415 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b03bbf-f94f-4696-9beb-59926aea427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:07.393755 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03bbf-f94f-4696-9beb-59926aea427a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.393755 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03bbf-f94f-4696-9beb-59926aea427a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.393755 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03bbf-f94f-4696-9beb-59926aea427a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.464002 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b03bbf-f94f-4696-9beb-59926aea427a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:07.465498 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b03bbf-f94f-4696-9beb-59926aea427a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:07.577160 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 295/592] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:12:07 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:07.585213 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d40b6-36dd-4eec-8eae-314e32492e15 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:07.695171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d40b6-36dd-4eec-8eae-314e32492e15 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:07.695543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81f80-8e7c-49f7-bf5e-809674942210 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.696025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81f80-8e7c-49f7-bf5e-809674942210 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.696495 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81f80-8e7c-49f7-bf5e-809674942210 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.698295 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 296/593] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:07.703750 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931c94e-08c6-4174-9d3f-b2ba1f6de980 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.704301 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931c94e-08c6-4174-9d3f-b2ba1f6de980 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.704754 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931c94e-08c6-4174-9d3f-b2ba1f6de980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.720345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:07.726324 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-d931c94e-08c6-4174-9d3f-b2ba1f6de980 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:07.727714 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-d931c94e-08c6-4174-9d3f-b2ba1f6de980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:07.731087 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225af00-1800-4ec5-bb60-3f5d54d6f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:07.731789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225af00-1800-4ec5-bb60-3f5d54d6f514 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.736674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225af00-1800-4ec5-bb60-3f5d54d6f514 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.736674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225af00-1800-4ec5-bb60-3f5d54d6f514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.743207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225af00-1800-4ec5-bb60-3f5d54d6f514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:07.744705 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225af00-1800-4ec5-bb60-3f5d54d6f514 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-4225af00-1800-4ec5-bb60-3f5d54d6f514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:07.761283 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:07.762216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:07.763157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:07.763157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:07.763157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:07.763157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:07.763157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 298/594] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:07.763441 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:07.768976 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225af00-1800-4ec5-bb60-3f5d54d6f514 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:07.812965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 297/595] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:12:07.836710 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931c94e-08c6-4174-9d3f-b2ba1f6de980 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:07.881687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225af00-1800-4ec5-bb60-3f5d54d6f514 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:07.928407 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48ac9b-cdf1-4cb7-88a8-37c11021c8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:07.929466 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48ac9b-cdf1-4cb7-88a8-37c11021c8ef None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.930208 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48ac9b-cdf1-4cb7-88a8-37c11021c8ef None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.930924 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48ac9b-cdf1-4cb7-88a8-37c11021c8ef None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.931929 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48ac9b-cdf1-4cb7-88a8-37c11021c8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:07.932704 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48ac9b-cdf1-4cb7-88a8-37c11021c8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:07.934703 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48ac9b-cdf1-4cb7-88a8-37c11021c8ef None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:07.938188 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931c94e-08c6-4174-9d3f-b2ba1f6de980 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:07.956582 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 299/596] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:07.957354 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48ac9b-cdf1-4cb7-88a8-37c11021c8ef None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:07.987040 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb306c-2792-439b-8cf0-10778b616bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:07.988245 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb306c-2792-439b-8cf0-10778b616bc2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:07.989060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb306c-2792-439b-8cf0-10778b616bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:07.989787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb306c-2792-439b-8cf0-10778b616bc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:07.992506 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:08.003929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb306c-2792-439b-8cf0-10778b616bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-3afb306c-2792-439b-8cf0-10778b616bc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:08.010168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:08.011199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:08.012032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:08.016274 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 298/597] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:12:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:08.018459 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb306c-2792-439b-8cf0-10778b616bc2 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:08.039767 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:08.068223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48ac9b-cdf1-4cb7-88a8-37c11021c8ef None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:08.105323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9df1b0-7263-4383-8b85-503a9c1e4f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:08.105969 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9df1b0-7263-4383-8b85-503a9c1e4f7a None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.106253 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9df1b0-7263-4383-8b85-503a9c1e4f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.106527 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9df1b0-7263-4383-8b85-503a9c1e4f7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.114421 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9df1b0-7263-4383-8b85-503a9c1e4f7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:08.116040 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9df1b0-7263-4383-8b85-503a9c1e4f7a None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-bd9df1b0-7263-4383-8b85-503a9c1e4f7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:08.129483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:08.130391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:08.131372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:08.131372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:08.131372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:08.131372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:08.131372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:08.131372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:08.131372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:08.131372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:08.131372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 300/598] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:08.138390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9df1b0-7263-4383-8b85-503a9c1e4f7a None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:08.141075 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb306c-2792-439b-8cf0-10778b616bc2 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:08.192260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aeb0a-991f-4207-8532-5ceb518045e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:08.192898 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aeb0a-991f-4207-8532-5ceb518045e6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.193176 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aeb0a-991f-4207-8532-5ceb518045e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.193450 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aeb0a-991f-4207-8532-5ceb518045e6 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.194166 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51aeb0a-991f-4207-8532-5ceb518045e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:08.194465 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51aeb0a-991f-4207-8532-5ceb518045e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:08.195842 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51aeb0a-991f-4207-8532-5ceb518045e6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:08.212181 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 299/599] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:12:08 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:08.214021 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aeb0a-991f-4207-8532-5ceb518045e6 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:08.259898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:08.265719 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9df1b0-7263-4383-8b85-503a9c1e4f7a None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:08.307883 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a019a-5fce-40f7-ba06-ba0e3c6028c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:08.308627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a019a-5fce-40f7-ba06-ba0e3c6028c7 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.308860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a019a-5fce-40f7-ba06-ba0e3c6028c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.309131 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a019a-5fce-40f7-ba06-ba0e3c6028c7 None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.309899 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a019a-5fce-40f7-ba06-ba0e3c6028c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:08.310290 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a019a-5fce-40f7-ba06-ba0e3c6028c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:08.311787 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a019a-5fce-40f7-ba06-ba0e3c6028c7 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:08.312804 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:08.330575 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 301/600] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:08.331422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a019a-5fce-40f7-ba06-ba0e3c6028c7 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:08.342315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aeb0a-991f-4207-8532-5ceb518045e6 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:08.385304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2728631-a9dc-46b1-b227-eb7d8e5dc0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:08.385967 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2728631-a9dc-46b1-b227-eb7d8e5dc0a0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.386199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2728631-a9dc-46b1-b227-eb7d8e5dc0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.386468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2728631-a9dc-46b1-b227-eb7d8e5dc0a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.401364 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2728631-a9dc-46b1-b227-eb7d8e5dc0a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:08.403252 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2728631-a9dc-46b1-b227-eb7d8e5dc0a0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f2728631-a9dc-46b1-b227-eb7d8e5dc0a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:08.425025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:08.425994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:08.426891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:08.426891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:08.426891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:08.426891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:08.426891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 300/601] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:08.435254 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2728631-a9dc-46b1-b227-eb7d8e5dc0a0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:08.472623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a019a-5fce-40f7-ba06-ba0e3c6028c7 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:08.509287 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80453c-0466-448e-8c03-b4b826e44af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:08.510167 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80453c-0466-448e-8c03-b4b826e44af0 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.510459 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80453c-0466-448e-8c03-b4b826e44af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.510730 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80453c-0466-448e-8c03-b4b826e44af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.511513 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80453c-0466-448e-8c03-b4b826e44af0 None admin] RBAC: Adding query filter params (role.id=58cdb402595a4191aa19b0b3a4ad8827, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=dcc3cee241bd45c49e37124cc4dd6e34) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:08.511817 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80453c-0466-448e-8c03-b4b826e44af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:08.513306 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80453c-0466-448e-8c03-b4b826e44af0 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:08.526366 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 302/602] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:12:08 2022] GET /identity/v3/role_assignments?user.id=dcc3cee241bd45c49e37124cc4dd6e34&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=58cdb402595a4191aa19b0b3a4ad8827 => generated 610 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:08.526366 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b1f11-c194-43a7-99b4-8302a73a60d8 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.526366 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b1f11-c194-43a7-99b4-8302a73a60d8 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.526366 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b1f11-c194-43a7-99b4-8302a73a60d8 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.526366 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 303/603] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:08.528145 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c61675-6f7e-4d2d-b0b6-1b0f7bfe5c81 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.529947 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c61675-6f7e-4d2d-b0b6-1b0f7bfe5c81 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.529947 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c61675-6f7e-4d2d-b0b6-1b0f7bfe5c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.550472 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-53c61675-6f7e-4d2d-b0b6-1b0f7bfe5c81 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:08.551847 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-53c61675-6f7e-4d2d-b0b6-1b0f7bfe5c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:08.558932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2728631-a9dc-46b1-b227-eb7d8e5dc0a0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:08.568986 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:08.592230 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:08.598355 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88284eb-b665-4f0b-8012-b8f49dd860af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:08.598999 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88284eb-b665-4f0b-8012-b8f49dd860af None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.599280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88284eb-b665-4f0b-8012-b8f49dd860af None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.599557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88284eb-b665-4f0b-8012-b8f49dd860af None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.600309 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88284eb-b665-4f0b-8012-b8f49dd860af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:08.600617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88284eb-b665-4f0b-8012-b8f49dd860af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:08.602047 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88284eb-b665-4f0b-8012-b8f49dd860af None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:08.620181 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 301/604] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:08.620181 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73065a2b-b1d1-4a88-b7d6-f633e41aae05 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.620181 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73065a2b-b1d1-4a88-b7d6-f633e41aae05 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.620181 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73065a2b-b1d1-4a88-b7d6-f633e41aae05 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.620181 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 302/605] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:08.624451 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73065a2b-b1d1-4a88-b7d6-f633e41aae05 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:08.644167 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 304/606] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:12:08.644167 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71695c8c-e234-4322-80f7-73d0ae7d525f None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.644167 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71695c8c-e234-4322-80f7-73d0ae7d525f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.644167 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71695c8c-e234-4322-80f7-73d0ae7d525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.673250 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-71695c8c-e234-4322-80f7-73d0ae7d525f None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:08.675048 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-71695c8c-e234-4322-80f7-73d0ae7d525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:08.755945 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73065a2b-b1d1-4a88-b7d6-f633e41aae05 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:08.765352 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 305/607] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:08.766206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71695c8c-e234-4322-80f7-73d0ae7d525f None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:08.796727 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457b8f8-6063-4a90-9752-3312a39a0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:08.797406 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457b8f8-6063-4a90-9752-3312a39a0e5f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.797683 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457b8f8-6063-4a90-9752-3312a39a0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.797951 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457b8f8-6063-4a90-9752-3312a39a0e5f None admin] PATH_INFO: `/v3/users/glance` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.808297 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457b8f8-6063-4a90-9752-3312a39a0e5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:08.809787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457b8f8-6063-4a90-9752-3312a39a0e5f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-c457b8f8-6063-4a90-9752-3312a39a0e5f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:08.822744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:08.823962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 303/608] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:12:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:08.825281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457b8f8-6063-4a90-9752-3312a39a0e5f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:08.864815 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:08.884887 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:08.885737 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71695c8c-e234-4322-80f7-73d0ae7d525f None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:08.936853 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daead6-8145-4900-bde1-1bbbb9dcfdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:08.938268 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daead6-8145-4900-bde1-1bbbb9dcfdbd None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.938990 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daead6-8145-4900-bde1-1bbbb9dcfdbd None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.939453 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22daead6-8145-4900-bde1-1bbbb9dcfdbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:08.945229 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457b8f8-6063-4a90-9752-3312a39a0e5f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:08.954743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22daead6-8145-4900-bde1-1bbbb9dcfdbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-22daead6-8145-4900-bde1-1bbbb9dcfdbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:08.961694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:08.962634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:08.963489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:08.965678 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 306/609] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:08.966241 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daead6-8145-4900-bde1-1bbbb9dcfdbd None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:08.993325 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc4055-53aa-4989-8e44-ae59ae53dc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:08.994110 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc4055-53aa-4989-8e44-ae59ae53dc32 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:08.994395 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc4055-53aa-4989-8e44-ae59ae53dc32 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:08.994969 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc4055-53aa-4989-8e44-ae59ae53dc32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:09.009456 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc4055-53aa-4989-8e44-ae59ae53dc32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-8cfc4055-53aa-4989-8e44-ae59ae53dc32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:09.016433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:09.017403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:12:09.018319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:09.020258 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 304/610] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:12:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:09.021217 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc4055-53aa-4989-8e44-ae59ae53dc32 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:09.112424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22daead6-8145-4900-bde1-1bbbb9dcfdbd None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:09.151456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060147c-ea2e-45d3-bd71-2d4bec6b628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:09.152440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060147c-ea2e-45d3-bd71-2d4bec6b628a None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:09.152790 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060147c-ea2e-45d3-bd71-2d4bec6b628a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:09.153127 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060147c-ea2e-45d3-bd71-2d4bec6b628a None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:09.157233 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060147c-ea2e-45d3-bd71-2d4bec6b628a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:09.157233 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060147c-ea2e-45d3-bd71-2d4bec6b628a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:09.157233 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060147c-ea2e-45d3-bd71-2d4bec6b628a None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:09.167206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:09.168820 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc4055-53aa-4989-8e44-ae59ae53dc32 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:09.181529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 307/611] 10.222.0.100 () {56 vars in 1142 bytes} [Tue Jul 26 15:12:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:09.182597 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060147c-ea2e-45d3-bd71-2d4bec6b628a None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:09.183678 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:09.205750 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51e6f7-a5ec-4382-b597-8df55d84c64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:09.206879 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51e6f7-a5ec-4382-b597-8df55d84c64f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:09.207168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51e6f7-a5ec-4382-b597-8df55d84c64f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:09.207442 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51e6f7-a5ec-4382-b597-8df55d84c64f None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:09.208339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51e6f7-a5ec-4382-b597-8df55d84c64f None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:09.208646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51e6f7-a5ec-4382-b597-8df55d84c64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:09.210029 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51e6f7-a5ec-4382-b597-8df55d84c64f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:09.218261 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 305/612] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:12:09 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:09.219072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51e6f7-a5ec-4382-b597-8df55d84c64f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:09.328517 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060147c-ea2e-45d3-bd71-2d4bec6b628a None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:09.360261 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51e6f7-a5ec-4382-b597-8df55d84c64f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:09.371593 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182de3c-9ef2-491f-9427-faa640d3604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:09.372297 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182de3c-9ef2-491f-9427-faa640d3604a None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:09.372484 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182de3c-9ef2-491f-9427-faa640d3604a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:09.372826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182de3c-9ef2-491f-9427-faa640d3604a None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:09.373451 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182de3c-9ef2-491f-9427-faa640d3604a None admin] RBAC: Adding query filter params (name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:09.373757 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182de3c-9ef2-491f-9427-faa640d3604a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:09.375153 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182de3c-9ef2-491f-9427-faa640d3604a None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:09.387674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 308/613] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:12:09 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:09.387674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182de3c-9ef2-491f-9427-faa640d3604a None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:09.400686 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762ba9a-6cf3-42ce-ae22-d19c6c2662c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:09.401419 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ba9a-6cf3-42ce-ae22-d19c6c2662c4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:09.401700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ba9a-6cf3-42ce-ae22-d19c6c2662c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:09.401974 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ba9a-6cf3-42ce-ae22-d19c6c2662c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:09.449603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:09.449813 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:09.476486 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762ba9a-6cf3-42ce-ae22-d19c6c2662c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:09.478490 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762ba9a-6cf3-42ce-ae22-d19c6c2662c4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:09.493948 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182de3c-9ef2-491f-9427-faa640d3604a None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:09.531363 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ff04b-25c9-4431-934b-2438086fe1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:09.532016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ff04b-25c9-4431-934b-2438086fe1cb None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:09.532328 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ff04b-25c9-4431-934b-2438086fe1cb None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:09.532608 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ff04b-25c9-4431-934b-2438086fe1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:09.544197 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ff04b-25c9-4431-934b-2438086fe1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:09.545656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ff04b-25c9-4431-934b-2438086fe1cb None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-a45ff04b-25c9-4431-934b-2438086fe1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:09.562291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:09.563379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:09.565552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:09.565552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:09.565552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:09.565552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:09.565552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 309/614] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:09.565552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ff04b-25c9-4431-934b-2438086fe1cb None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:09.597545 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 306/615] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:12:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:09.597545 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762ba9a-6cf3-42ce-ae22-d19c6c2662c4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:09.677192 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:09.683215 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ff04b-25c9-4431-934b-2438086fe1cb None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:09.698150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:09.704234 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762ba9a-6cf3-42ce-ae22-d19c6c2662c4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:09.718556 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa8f1e-40f4-4ae2-9e6b-9c637c668eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:09.719197 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa8f1e-40f4-4ae2-9e6b-9c637c668eef None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:09.719473 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa8f1e-40f4-4ae2-9e6b-9c637c668eef None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:09.719747 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa8f1e-40f4-4ae2-9e6b-9c637c668eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:09.730348 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa8f1e-40f4-4ae2-9e6b-9c637c668eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:09.731816 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa8f1e-40f4-4ae2-9e6b-9c637c668eef None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:09.742020 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01dc3-6562-490c-9c07-69005bdbb934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:09.742615 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01dc3-6562-490c-9c07-69005bdbb934 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:09.742900 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01dc3-6562-490c-9c07-69005bdbb934 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:09.743180 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01dc3-6562-490c-9c07-69005bdbb934 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:09.743869 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01dc3-6562-490c-9c07-69005bdbb934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:09.744204 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01dc3-6562-490c-9c07-69005bdbb934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:09.745597 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01dc3-6562-490c-9c07-69005bdbb934 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-d8aa8f1e-40f4-4ae2-9e6b-9c637c668eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:09.751424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:09.753065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:09.754037 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:09.754037 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:09.754037 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:09.754037 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:09.754844 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 310/616] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:09.755190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa8f1e-40f4-4ae2-9e6b-9c637c668eef None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:09.761354 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 307/617] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:09.762469 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01dc3-6562-490c-9c07-69005bdbb934 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:09.868066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa8f1e-40f4-4ae2-9e6b-9c637c668eef None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:09.868275 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01dc3-6562-490c-9c07-69005bdbb934 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:09.903630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283231-fb2a-49ea-981e-d7e4ea937214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:09.904307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283231-fb2a-49ea-981e-d7e4ea937214 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:09.904668 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283231-fb2a-49ea-981e-d7e4ea937214 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:09.904950 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af283231-fb2a-49ea-981e-d7e4ea937214 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:09.905175 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c970c-e8e7-41cd-8add-9f8b53a3c053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:09.905645 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283231-fb2a-49ea-981e-d7e4ea937214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:09.905952 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283231-fb2a-49ea-981e-d7e4ea937214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:09.906278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c970c-e8e7-41cd-8add-9f8b53a3c053 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:09.906700 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c970c-e8e7-41cd-8add-9f8b53a3c053 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:09.907120 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c970c-e8e7-41cd-8add-9f8b53a3c053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:09.907345 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af283231-fb2a-49ea-981e-d7e4ea937214 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:09.909469 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:09.920019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c970c-e8e7-41cd-8add-9f8b53a3c053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:09.926263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 308/618] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:09.926399 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c970c-e8e7-41cd-8add-9f8b53a3c053 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:09.926513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283231-fb2a-49ea-981e-d7e4ea937214 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-1f7c970c-e8e7-41cd-8add-9f8b53a3c053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:09.941578 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:09.942676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:09.943576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:09.943576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:09.943576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:09.943576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:09.943576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 311/619] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:09.943576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c970c-e8e7-41cd-8add-9f8b53a3c053 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:09.964993 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:10.035883 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af283231-fb2a-49ea-981e-d7e4ea937214 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:10.048616 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c970c-e8e7-41cd-8add-9f8b53a3c053 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:10.075694 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d32e5-bfb5-424c-982d-4fd845b072a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:10.076436 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d32e5-bfb5-424c-982d-4fd845b072a8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.076983 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d32e5-bfb5-424c-982d-4fd845b072a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.077260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d32e5-bfb5-424c-982d-4fd845b072a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.085220 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf50af8-9de1-4159-b5c2-c4d95b433919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:10.085833 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d32e5-bfb5-424c-982d-4fd845b072a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:10.085942 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf50af8-9de1-4159-b5c2-c4d95b433919 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.086118 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf50af8-9de1-4159-b5c2-c4d95b433919 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.086389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf50af8-9de1-4159-b5c2-c4d95b433919 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.087290 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d32e5-bfb5-424c-982d-4fd845b072a8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:10.093670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf50af8-9de1-4159-b5c2-c4d95b433919 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:10.095125 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf50af8-9de1-4159-b5c2-c4d95b433919 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-f35d32e5-bfb5-424c-982d-4fd845b072a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:10.102468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:10.103504 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 309/620] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:12:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:10.109650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d32e5-bfb5-424c-982d-4fd845b072a8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-adf50af8-9de1-4159-b5c2-c4d95b433919 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:10.110677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:10.111623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:10.113126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:10.113126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:10.113126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:10.113126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:10.113126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:10.113126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:10.113126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:10.113126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:10.113126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 15:12:10.113126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:10.115618 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 312/621] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:12:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:10.115618 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf50af8-9de1-4159-b5c2-c4d95b433919 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:10.171618 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:10.201639 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:10.225233 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d32e5-bfb5-424c-982d-4fd845b072a8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:10.230792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf50af8-9de1-4159-b5c2-c4d95b433919 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:10.266636 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991584e-497b-4e86-b014-c9b25baf0cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:10.267249 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991584e-497b-4e86-b014-c9b25baf0cf3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.267533 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991584e-497b-4e86-b014-c9b25baf0cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.268370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991584e-497b-4e86-b014-c9b25baf0cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.269056 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991584e-497b-4e86-b014-c9b25baf0cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:10.269359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991584e-497b-4e86-b014-c9b25baf0cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:10.269535 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f0b51-04e4-4fc6-bca0-25b0e84a77b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:10.270131 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0b51-04e4-4fc6-bca0-25b0e84a77b8 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.270414 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0b51-04e4-4fc6-bca0-25b0e84a77b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.270687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f0b51-04e4-4fc6-bca0-25b0e84a77b8 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.270781 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991584e-497b-4e86-b014-c9b25baf0cf3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:10.271469 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f0b51-04e4-4fc6-bca0-25b0e84a77b8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:10.271772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f0b51-04e4-4fc6-bca0-25b0e84a77b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:10.273336 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f0b51-04e4-4fc6-bca0-25b0e84a77b8 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:10.283475 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 310/622] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:10.284345 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991584e-497b-4e86-b014-c9b25baf0cf3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:10.296715 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 313/623] 10.222.0.100 () {56 vars in 1142 bytes} [Tue Jul 26 15:12:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:10.297577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f0b51-04e4-4fc6-bca0-25b0e84a77b8 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:10.398597 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991584e-497b-4e86-b014-c9b25baf0cf3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:10.414959 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:10.417946 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f0b51-04e4-4fc6-bca0-25b0e84a77b8 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:10.438861 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dd5b1-42eb-4ffd-83cb-fffdff6c8af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:10.440206 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dd5b1-42eb-4ffd-83cb-fffdff6c8af8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.440641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dd5b1-42eb-4ffd-83cb-fffdff6c8af8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.441357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dd5b1-42eb-4ffd-83cb-fffdff6c8af8 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.442468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dd5b1-42eb-4ffd-83cb-fffdff6c8af8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:10.443251 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dd5b1-42eb-4ffd-83cb-fffdff6c8af8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:10.445127 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dd5b1-42eb-4ffd-83cb-fffdff6c8af8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:10.454263 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfcd76-317a-4993-82eb-7bd8095701a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:10.454899 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfcd76-317a-4993-82eb-7bd8095701a2 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.455180 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfcd76-317a-4993-82eb-7bd8095701a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.455997 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfcd76-317a-4993-82eb-7bd8095701a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.458258 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:10.463572 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfcd76-317a-4993-82eb-7bd8095701a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:10.465106 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfcd76-317a-4993-82eb-7bd8095701a2 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:10.469285 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 311/624] 10.222.0.100 () {56 vars in 1144 bytes} [Tue Jul 26 15:12:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:10.470309 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dd5b1-42eb-4ffd-83cb-fffdff6c8af8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-84cfcd76-317a-4993-82eb-7bd8095701a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:10.477636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:10.478550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:10.479450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:10.479450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:10.479450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:10.479450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:10.479450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:10.479450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:10.479450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:10.479450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:10.484068 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 314/625] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:10.484902 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfcd76-317a-4993-82eb-7bd8095701a2 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:10.586863 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dd5b1-42eb-4ffd-83cb-fffdff6c8af8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:10.597971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfcd76-317a-4993-82eb-7bd8095701a2 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:10.622582 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f1ca3-4e5d-4c38-bfd3-3b49ae1b1ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:10.623284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1ca3-4e5d-4c38-bfd3-3b49ae1b1ce4 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.623474 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1ca3-4e5d-4c38-bfd3-3b49ae1b1ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.623734 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1ca3-4e5d-4c38-bfd3-3b49ae1b1ce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.635588 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559084e-d7dc-4318-9531-6224bad9bcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:10.636289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559084e-d7dc-4318-9531-6224bad9bcec None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.636569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559084e-d7dc-4318-9531-6224bad9bcec None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.636945 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4559084e-d7dc-4318-9531-6224bad9bcec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.669627 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:10.698995 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f1ca3-4e5d-4c38-bfd3-3b49ae1b1ce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:10.700387 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f1ca3-4e5d-4c38-bfd3-3b49ae1b1ce4 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:10.707810 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:10.717215 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559084e-d7dc-4318-9531-6224bad9bcec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:10.718698 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4559084e-d7dc-4318-9531-6224bad9bcec None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:10.814164 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 312/626] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:12:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:10.815696 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f1ca3-4e5d-4c38-bfd3-3b49ae1b1ce4 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:10.842311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 315/627] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:12:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:10.843164 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559084e-d7dc-4318-9531-6224bad9bcec None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:10.896542 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:10.926053 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f1ca3-4e5d-4c38-bfd3-3b49ae1b1ce4 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:10.942969 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:10.950087 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4559084e-d7dc-4318-9531-6224bad9bcec None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:10.960535 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e144c1-8976-4d05-bba5-e768d075a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:10.961234 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e144c1-8976-4d05-bba5-e768d075a3da None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.961513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e144c1-8976-4d05-bba5-e768d075a3da None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.961786 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e144c1-8976-4d05-bba5-e768d075a3da None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.962522 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e144c1-8976-4d05-bba5-e768d075a3da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:10.962828 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e144c1-8976-4d05-bba5-e768d075a3da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:10.964285 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e144c1-8976-4d05-bba5-e768d075a3da None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:10.976556 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 313/628] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:10.977338 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e144c1-8976-4d05-bba5-e768d075a3da None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:10.985148 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a230000-ccc7-4697-bd71-41848db16619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:10.985789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230000-ccc7-4697-bd71-41848db16619 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:10.986075 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230000-ccc7-4697-bd71-41848db16619 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:10.986350 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a230000-ccc7-4697-bd71-41848db16619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:10.997288 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a230000-ccc7-4697-bd71-41848db16619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:10.998737 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a230000-ccc7-4697-bd71-41848db16619 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-5a230000-ccc7-4697-bd71-41848db16619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:11.013423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:11.014389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:11.015291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:11.015291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:11.015291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:11.015291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:11.015291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 316/629] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:11.016257 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0581ea-34a9-4761-bbf0-3f4e2086c610 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.016539 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0581ea-34a9-4761-bbf0-3f4e2086c610 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.016809 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0581ea-34a9-4761-bbf0-3f4e2086c610 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.018794 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 317/630] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:11.019408 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0581ea-34a9-4761-bbf0-3f4e2086c610 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.078634 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e144c1-8976-4d05-bba5-e768d075a3da None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.107735 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.112892 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24be8-0636-4e93-a853-0bb7472d706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.113525 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24be8-0636-4e93-a853-0bb7472d706a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.113802 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24be8-0636-4e93-a853-0bb7472d706a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.114078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24be8-0636-4e93-a853-0bb7472d706a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.122458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0581ea-34a9-4761-bbf0-3f4e2086c610 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.126349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24be8-0636-4e93-a853-0bb7472d706a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:11.126349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24be8-0636-4e93-a853-0bb7472d706a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-bac24be8-0636-4e93-a853-0bb7472d706a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:11.139980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:11.141108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:11.142041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:11.142041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:11.142041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:11.142041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:11.142041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 314/631] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:11.142336 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24be8-0636-4e93-a853-0bb7472d706a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.157030 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6866e6-5de4-4452-9fd0-77ebefa70a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.157651 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6866e6-5de4-4452-9fd0-77ebefa70a82 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.157936 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6866e6-5de4-4452-9fd0-77ebefa70a82 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.158216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6866e6-5de4-4452-9fd0-77ebefa70a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.159553 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6866e6-5de4-4452-9fd0-77ebefa70a82 None admin] RBAC: Adding query filter params (role.id=58cdb402595a4191aa19b0b3a4ad8827, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=4f62b11cb0dc462caeacfdba8cd45658) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:11.159866 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6866e6-5de4-4452-9fd0-77ebefa70a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:11.161364 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6866e6-5de4-4452-9fd0-77ebefa70a82 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.167427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 318/632] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/role_assignments?user.id=4f62b11cb0dc462caeacfdba8cd45658&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=58cdb402595a4191aa19b0b3a4ad8827 => generated 610 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:11.168596 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0fc2b-d48b-4fa8-abed-c58a5224e5fb None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.168887 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0fc2b-d48b-4fa8-abed-c58a5224e5fb None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.169418 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0fc2b-d48b-4fa8-abed-c58a5224e5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.196598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-71b0fc2b-d48b-4fa8-abed-c58a5224e5fb None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:11.197854 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-71b0fc2b-d48b-4fa8-abed-c58a5224e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:11.201585 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.252873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24be8-0636-4e93-a853-0bb7472d706a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.292173 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 319/633] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:11.292173 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0fc2b-d48b-4fa8-abed-c58a5224e5fb None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.308663 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66d250-cf71-4e1b-9f89-eddbaa35b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.309303 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66d250-cf71-4e1b-9f89-eddbaa35b06b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.309584 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66d250-cf71-4e1b-9f89-eddbaa35b06b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.309857 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66d250-cf71-4e1b-9f89-eddbaa35b06b None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.310563 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66d250-cf71-4e1b-9f89-eddbaa35b06b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:11.310854 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66d250-cf71-4e1b-9f89-eddbaa35b06b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:11.312308 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66d250-cf71-4e1b-9f89-eddbaa35b06b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.326228 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 315/634] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:11.327100 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66d250-cf71-4e1b-9f89-eddbaa35b06b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.384967 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.412222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0fc2b-d48b-4fa8-abed-c58a5224e5fb None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.448234 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66d250-cf71-4e1b-9f89-eddbaa35b06b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.450038 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bdef1-a6b3-4df7-a08b-2824164eadb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.450664 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bdef1-a6b3-4df7-a08b-2824164eadb3 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.450943 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bdef1-a6b3-4df7-a08b-2824164eadb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.451304 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bdef1-a6b3-4df7-a08b-2824164eadb3 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.452051 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bdef1-a6b3-4df7-a08b-2824164eadb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:11.452433 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bdef1-a6b3-4df7-a08b-2824164eadb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:11.453847 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bdef1-a6b3-4df7-a08b-2824164eadb3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.463549 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.466875 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 320/635] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:11.467884 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bdef1-a6b3-4df7-a08b-2824164eadb3 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.492467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c3e7c-b99f-47c3-8aff-cee3c76ccfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.493035 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c3e7c-b99f-47c3-8aff-cee3c76ccfc7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.493326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c3e7c-b99f-47c3-8aff-cee3c76ccfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.493601 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c3e7c-b99f-47c3-8aff-cee3c76ccfc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.504708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c3e7c-b99f-47c3-8aff-cee3c76ccfc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-3d0c3e7c-b99f-47c3-8aff-cee3c76ccfc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:11.509543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:11.510623 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 316/636] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:11.511473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c3e7c-b99f-47c3-8aff-cee3c76ccfc7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.589276 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bdef1-a6b3-4df7-a08b-2824164eadb3 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.614364 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c3e7c-b99f-47c3-8aff-cee3c76ccfc7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.616657 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.625785 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d7cc-1fd3-49ec-9606-a40fa3cb4f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.626437 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d7cc-1fd3-49ec-9606-a40fa3cb4f98 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.626723 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d7cc-1fd3-49ec-9606-a40fa3cb4f98 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.627002 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d7cc-1fd3-49ec-9606-a40fa3cb4f98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.634991 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9d7cc-1fd3-49ec-9606-a40fa3cb4f98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:11.636526 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9d7cc-1fd3-49ec-9606-a40fa3cb4f98 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-c3f9d7cc-1fd3-49ec-9606-a40fa3cb4f98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:11.648619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:11.649641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:11.650550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:11.650550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:11.650550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:11.650550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:11.650550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:11.650550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:11.650550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:11.650550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:11.650550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 321/637] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:11.650550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d7cc-1fd3-49ec-9606-a40fa3cb4f98 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.659364 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd73f8-67b1-42d7-b049-373332ca11df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.660014 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd73f8-67b1-42d7-b049-373332ca11df None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.660332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd73f8-67b1-42d7-b049-373332ca11df None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.660614 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd73f8-67b1-42d7-b049-373332ca11df None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.669745 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd73f8-67b1-42d7-b049-373332ca11df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:11.671223 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd73f8-67b1-42d7-b049-373332ca11df None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-98dd73f8-67b1-42d7-b049-373332ca11df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:11.682848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:11.684072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:11.685103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:11.685103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:11.685103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:11.685103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:11.685103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:11.685103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:11.685103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:11.685103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:11.685103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 317/638] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:11.685103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd73f8-67b1-42d7-b049-373332ca11df None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.721575 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.764833 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d7cc-1fd3-49ec-9606-a40fa3cb4f98 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.803440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a923e63-e22c-401d-9521-34eda903d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.804204 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a923e63-e22c-401d-9521-34eda903d42e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.804565 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a923e63-e22c-401d-9521-34eda903d42e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.804909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd73f8-67b1-42d7-b049-373332ca11df None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.805032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a923e63-e22c-401d-9521-34eda903d42e None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.805700 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a923e63-e22c-401d-9521-34eda903d42e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:11.806073 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a923e63-e22c-401d-9521-34eda903d42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:11.807521 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a923e63-e22c-401d-9521-34eda903d42e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.817302 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 322/639] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:11.817937 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a923e63-e22c-401d-9521-34eda903d42e None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.847338 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b9a04-5fef-4566-b583-33b31858bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.847952 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9a04-5fef-4566-b583-33b31858bf0c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.848265 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9a04-5fef-4566-b583-33b31858bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.848539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9a04-5fef-4566-b583-33b31858bf0c None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.849282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b9a04-5fef-4566-b583-33b31858bf0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:11.849589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b9a04-5fef-4566-b583-33b31858bf0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:11.851008 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b9a04-5fef-4566-b583-33b31858bf0c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.863485 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 318/640] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:11.864169 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b9a04-5fef-4566-b583-33b31858bf0c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:11.889766 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.928223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a923e63-e22c-401d-9521-34eda903d42e None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.952315 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.965573 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960c952-4218-465d-bc7d-9d0cc2e344bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:11.966189 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960c952-4218-465d-bc7d-9d0cc2e344bd None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:11.966471 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960c952-4218-465d-bc7d-9d0cc2e344bd None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:11.966836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960c952-4218-465d-bc7d-9d0cc2e344bd None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:11.967579 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960c952-4218-465d-bc7d-9d0cc2e344bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:11.967885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960c952-4218-465d-bc7d-9d0cc2e344bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:11.969350 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960c952-4218-465d-bc7d-9d0cc2e344bd None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:11.971924 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b9a04-5fef-4566-b583-33b31858bf0c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:11.987033 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 323/641] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:11.987033 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960c952-4218-465d-bc7d-9d0cc2e344bd None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:12.015441 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23e8e2-5920-4c69-8118-471b8f7c8b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:12.016079 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23e8e2-5920-4c69-8118-471b8f7c8b60 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:12.016403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23e8e2-5920-4c69-8118-471b8f7c8b60 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:12.016677 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23e8e2-5920-4c69-8118-471b8f7c8b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:12.027409 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23e8e2-5920-4c69-8118-471b8f7c8b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:12.028872 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23e8e2-5920-4c69-8118-471b8f7c8b60 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-3c23e8e2-5920-4c69-8118-471b8f7c8b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:12.044752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:12.045847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:12.046738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:12.046738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:12.046738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:12.046738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:12.046738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 319/642] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:12.047029 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23e8e2-5920-4c69-8118-471b8f7c8b60 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:12.096053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960c952-4218-465d-bc7d-9d0cc2e344bd None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:12.130886 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:12.135969 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01225-529e-463a-acb5-8ef572b3cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:12.136619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01225-529e-463a-acb5-8ef572b3cbda None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:12.136903 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01225-529e-463a-acb5-8ef572b3cbda None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:12.137181 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c01225-529e-463a-acb5-8ef572b3cbda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:12.137964 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01225-529e-463a-acb5-8ef572b3cbda None admin] RBAC: Adding query filter params (role.id=58cdb402595a4191aa19b0b3a4ad8827, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=c5e22a12ebdd493c8c14cfaf2dfc1af2) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:12.138274 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01225-529e-463a-acb5-8ef572b3cbda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:12.153495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c01225-529e-463a-acb5-8ef572b3cbda None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:12.153495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 324/643] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:12:11 2022] GET /identity/v3/role_assignments?user.id=c5e22a12ebdd493c8c14cfaf2dfc1af2&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=58cdb402595a4191aa19b0b3a4ad8827 => generated 610 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:12.153495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01225-529e-463a-acb5-8ef572b3cbda None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:12.158070 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23e8e2-5920-4c69-8118-471b8f7c8b60 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:12.201556 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3498c-d5bb-480e-8c73-3a9f4158e5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:12.202671 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3498c-d5bb-480e-8c73-3a9f4158e5f7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:12.203255 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3498c-d5bb-480e-8c73-3a9f4158e5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:12.203737 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3498c-d5bb-480e-8c73-3a9f4158e5f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:12.204816 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3498c-d5bb-480e-8c73-3a9f4158e5f7 None admin] RBAC: Adding query filter params (role.id=58cdb402595a4191aa19b0b3a4ad8827, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=50361b26fc1441ea9e78b3f59f1e4f8f) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:12.205606 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3498c-d5bb-480e-8c73-3a9f4158e5f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:12.207450 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3498c-d5bb-480e-8c73-3a9f4158e5f7 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:12.214632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:12.216746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 320/644] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:12:12 2022] GET /identity/v3/role_assignments?user.id=50361b26fc1441ea9e78b3f59f1e4f8f&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=58cdb402595a4191aa19b0b3a4ad8827 => generated 610 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:12.287872 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c01225-529e-463a-acb5-8ef572b3cbda None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:12.332207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3110ce-3ae8-4fdb-b9f2-ca85e86a4f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:12.333238 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3110ce-3ae8-4fdb-b9f2-ca85e86a4f69 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:12.333735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3110ce-3ae8-4fdb-b9f2-ca85e86a4f69 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:12.334237 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3110ce-3ae8-4fdb-b9f2-ca85e86a4f69 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:12.335200 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3110ce-3ae8-4fdb-b9f2-ca85e86a4f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:12.335744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3110ce-3ae8-4fdb-b9f2-ca85e86a4f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:12.337402 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3110ce-3ae8-4fdb-b9f2-ca85e86a4f69 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:12.352709 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 325/645] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:12.358725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3498c-d5bb-480e-8c73-3a9f4158e5f7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:12.478383 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3498c-d5bb-480e-8c73-3a9f4158e5f7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:12.518655 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0be91-73cc-4c34-8ba5-307ced0b7386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:12.519299 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0be91-73cc-4c34-8ba5-307ced0b7386 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:12.519586 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0be91-73cc-4c34-8ba5-307ced0b7386 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:12.519855 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0be91-73cc-4c34-8ba5-307ced0b7386 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:12.527827 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0be91-73cc-4c34-8ba5-307ced0b7386 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:12.529381 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0be91-73cc-4c34-8ba5-307ced0b7386 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:12.532555 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-4ff0be91-73cc-4c34-8ba5-307ced0b7386 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:12.543330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:12.544348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:12.545300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 321/646] 10.222.0.100 () {56 vars in 1098 bytes} [Tue Jul 26 15:12:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:12.550545 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3110ce-3ae8-4fdb-b9f2-ca85e86a4f69 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:12.656990 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3110ce-3ae8-4fdb-b9f2-ca85e86a4f69 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:12.664617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:12.694560 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8abf6-a0bb-4c90-9137-d7c110ea1199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:12.695186 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8abf6-a0bb-4c90-9137-d7c110ea1199 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:12.695469 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8abf6-a0bb-4c90-9137-d7c110ea1199 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:12.695743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8abf6-a0bb-4c90-9137-d7c110ea1199 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:12.696647 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8abf6-a0bb-4c90-9137-d7c110ea1199 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:12.696879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8abf6-a0bb-4c90-9137-d7c110ea1199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:12.698314 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8abf6-a0bb-4c90-9137-d7c110ea1199 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:12.716930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 326/647] 10.222.0.100 () {56 vars in 1138 bytes} [Tue Jul 26 15:12:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:12.722404 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0be91-73cc-4c34-8ba5-307ced0b7386 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:12.833123 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0be91-73cc-4c34-8ba5-307ced0b7386 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:12.870205 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0b7b-77a9-45cb-b629-239c4cc9b8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:12.870824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0b7b-77a9-45cb-b629-239c4cc9b8cf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:12.871161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0b7b-77a9-45cb-b629-239c4cc9b8cf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:12.871444 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0b7b-77a9-45cb-b629-239c4cc9b8cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:12.947728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:12.950416 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df0b7b-77a9-45cb-b629-239c4cc9b8cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:12.951891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df0b7b-77a9-45cb-b629-239c4cc9b8cf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:13.059460 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 322/648] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:12:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:13.065234 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8abf6-a0bb-4c90-9137-d7c110ea1199 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:13.171895 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8abf6-a0bb-4c90-9137-d7c110ea1199 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:13.210784 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afc3d5-6c9b-406f-9df2-b71b6f2d4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:13.211814 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afc3d5-6c9b-406f-9df2-b71b6f2d4759 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.212333 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afc3d5-6c9b-406f-9df2-b71b6f2d4759 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.212842 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afc3d5-6c9b-406f-9df2-b71b6f2d4759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.223935 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afc3d5-6c9b-406f-9df2-b71b6f2d4759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:13.225684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afc3d5-6c9b-406f-9df2-b71b6f2d4759 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-b3afc3d5-6c9b-406f-9df2-b71b6f2d4759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:13.241296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:13.242246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:13.243139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:13.243139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:13.243139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:13.243139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:13.245370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 327/649] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:13.256147 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0b7b-77a9-45cb-b629-239c4cc9b8cf None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:13.353371 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:13.357123 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0b7b-77a9-45cb-b629-239c4cc9b8cf None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:13.395252 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61517249-cfbd-4cab-9cde-a5f35c1d907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:13.395867 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517249-cfbd-4cab-9cde-a5f35c1d907f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.396187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517249-cfbd-4cab-9cde-a5f35c1d907f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.396467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61517249-cfbd-4cab-9cde-a5f35c1d907f None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.397163 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61517249-cfbd-4cab-9cde-a5f35c1d907f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:13.397466 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61517249-cfbd-4cab-9cde-a5f35c1d907f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:13.398833 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61517249-cfbd-4cab-9cde-a5f35c1d907f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:13.410946 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 323/650] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:13.416377 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afc3d5-6c9b-406f-9df2-b71b6f2d4759 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:13.436985 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:13.509501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c412093-efc6-4b96-9f9f-24edb18aafca None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.510525 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c412093-efc6-4b96-9f9f-24edb18aafca None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.511011 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c412093-efc6-4b96-9f9f-24edb18aafca None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.512985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 324/651] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:12:13.518411 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e35b0-1197-4dea-a559-ad11bb7f6ab8 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.519033 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e35b0-1197-4dea-a559-ad11bb7f6ab8 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.519508 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e35b0-1197-4dea-a559-ad11bb7f6ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.533318 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afc3d5-6c9b-406f-9df2-b71b6f2d4759 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:13.544449 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-329e35b0-1197-4dea-a559-ad11bb7f6ab8 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:13.546773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-329e35b0-1197-4dea-a559-ad11bb7f6ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:13.572877 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac899dc-5c28-4bad-ab5c-422d56a2dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:13.573523 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac899dc-5c28-4bad-ab5c-422d56a2dace None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.573862 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac899dc-5c28-4bad-ab5c-422d56a2dace None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.574137 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac899dc-5c28-4bad-ab5c-422d56a2dace None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.581477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac899dc-5c28-4bad-ab5c-422d56a2dace None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:13.582978 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac899dc-5c28-4bad-ab5c-422d56a2dace None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-fac899dc-5c28-4bad-ab5c-422d56a2dace None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:13.598323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:13.599278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:13.600251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:13.600251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:13.600251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:13.600251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:13.600251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:13.600251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:13.600251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:13.600251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:13.600251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 328/652] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:13.605770 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac899dc-5c28-4bad-ab5c-422d56a2dace None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:13.639441 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 325/653] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:13.666822 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e35b0-1197-4dea-a559-ad11bb7f6ab8 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:13.706917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:13.735770 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac899dc-5c28-4bad-ab5c-422d56a2dace None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:13.781178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:13.787298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51389358-b9dc-4285-853a-2d55afd33deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:13.787920 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389358-b9dc-4285-853a-2d55afd33deb None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.788258 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389358-b9dc-4285-853a-2d55afd33deb None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.788542 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389358-b9dc-4285-853a-2d55afd33deb None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.789515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51389358-b9dc-4285-853a-2d55afd33deb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:13.789830 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51389358-b9dc-4285-853a-2d55afd33deb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:13.792157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51389358-b9dc-4285-853a-2d55afd33deb None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:13.793535 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e35b0-1197-4dea-a559-ad11bb7f6ab8 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:13.812270 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 329/654] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:13.815471 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51389358-b9dc-4285-853a-2d55afd33deb None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:13.844317 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac2013-0ae4-4781-b595-758c7c795f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:13.845445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2013-0ae4-4781-b595-758c7c795f2a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.846540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2013-0ae4-4781-b595-758c7c795f2a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.847050 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2013-0ae4-4781-b595-758c7c795f2a None admin] PATH_INFO: `/v3/services/image` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.848663 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac2013-0ae4-4781-b595-758c7c795f2a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:13.850372 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac2013-0ae4-4781-b595-758c7c795f2a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-44ac2013-0ae4-4781-b595-758c7c795f2a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:13.866690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:13.867761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:12:13.868775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:13.872694 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 326/655] 10.222.0.100 () {56 vars in 1110 bytes} [Tue Jul 26 15:12:13 2022] GET /identity/v3/services/image => generated 86 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:13.873633 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac2013-0ae4-4781-b595-758c7c795f2a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:13.946975 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51389358-b9dc-4285-853a-2d55afd33deb None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:13.983571 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35fccb-1604-421d-a304-3c4f79308f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:13.984567 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35fccb-1604-421d-a304-3c4f79308f1a None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:13.985116 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35fccb-1604-421d-a304-3c4f79308f1a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:13.985694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35fccb-1604-421d-a304-3c4f79308f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:13.987311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35fccb-1604-421d-a304-3c4f79308f1a None admin] RBAC: Adding query filter params (role.id=6d23401ca57e47398bf036ea320a7617, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=dcc3cee241bd45c49e37124cc4dd6e34) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:13.987827 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35fccb-1604-421d-a304-3c4f79308f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:13.989546 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35fccb-1604-421d-a304-3c4f79308f1a None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:13.992884 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:14.003054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac2013-0ae4-4781-b595-758c7c795f2a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:14.003389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 330/656] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:12:13 2022] GET /identity/v3/role_assignments?user.id=dcc3cee241bd45c49e37124cc4dd6e34&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=6d23401ca57e47398bf036ea320a7617 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:14.043660 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c309b-8faa-400d-a1f8-a236562a5780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:14.044314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c309b-8faa-400d-a1f8-a236562a5780 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:14.044607 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c309b-8faa-400d-a1f8-a236562a5780 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:14.044893 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c309b-8faa-400d-a1f8-a236562a5780 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:14.045799 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c309b-8faa-400d-a1f8-a236562a5780 None admin] RBAC: Adding query filter params (name=image) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:14.046106 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c309b-8faa-400d-a1f8-a236562a5780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:14.047510 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c309b-8faa-400d-a1f8-a236562a5780 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:14.053129 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 327/657] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:13 2022] GET /identity/v3/services?name=image => generated 123 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:14.058938 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35fccb-1604-421d-a304-3c4f79308f1a None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:14.175294 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35fccb-1604-421d-a304-3c4f79308f1a None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:14.212104 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75c96b-541e-4667-a1a3-d0923d418002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:14.212761 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c96b-541e-4667-a1a3-d0923d418002 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:14.213045 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c96b-541e-4667-a1a3-d0923d418002 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:14.213324 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75c96b-541e-4667-a1a3-d0923d418002 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:14.214105 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75c96b-541e-4667-a1a3-d0923d418002 None admin] RBAC: Adding query filter params (type=image) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:14.214409 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75c96b-541e-4667-a1a3-d0923d418002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:14.215793 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75c96b-541e-4667-a1a3-d0923d418002 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:14.223100 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 331/658] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:14 2022] GET /identity/v3/services?type=image => generated 123 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:14.681634 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1ca2-692e-4c7f-b458-66d79b944592 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:14.682152 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1ca2-692e-4c7f-b458-66d79b944592 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:14.682253 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca1ca2-692e-4c7f-b458-66d79b944592 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:14.685758 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 328/659] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:14 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:14.691522 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7fe6-8b60-4811-9ac4-a5b06ad6dc43 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:14.691822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7fe6-8b60-4811-9ac4-a5b06ad6dc43 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:14.692107 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad7fe6-8b60-4811-9ac4-a5b06ad6dc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:14.711427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-91ad7fe6-8b60-4811-9ac4-a5b06ad6dc43 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:14.712624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-91ad7fe6-8b60-4811-9ac4-a5b06ad6dc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:14.754451 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5877e6-dd6a-458d-aa30-8fe376bb8c02 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:14.754641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5877e6-dd6a-458d-aa30-8fe376bb8c02 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:14.754917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5877e6-dd6a-458d-aa30-8fe376bb8c02 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:14.757515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 329/660] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:12:14.761633 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcc20a-6a9f-475f-9ef4-35a6c3c015a2 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:14.761915 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcc20a-6a9f-475f-9ef4-35a6c3c015a2 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:14.762188 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcc20a-6a9f-475f-9ef4-35a6c3c015a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:14.780969 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-24dcc20a-6a9f-475f-9ef4-35a6c3c015a2 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:14.782054 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:14.782239 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-24dcc20a-6a9f-475f-9ef4-35a6c3c015a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:14.792462 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 332/661] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:14.801690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:14.816220 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad7fe6-8b60-4811-9ac4-a5b06ad6dc43 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:14.872222 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 330/662] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:12:14.888234 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcc20a-6a9f-475f-9ef4-35a6c3c015a2 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:14.935535 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad7fe6-8b60-4811-9ac4-a5b06ad6dc43 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:14.972880 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6052cc-63bf-4517-86fa-340adfceabfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:14.973532 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6052cc-63bf-4517-86fa-340adfceabfd None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:14.973816 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6052cc-63bf-4517-86fa-340adfceabfd None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:14.974097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6052cc-63bf-4517-86fa-340adfceabfd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:14.974728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6052cc-63bf-4517-86fa-340adfceabfd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:14.976136 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6052cc-63bf-4517-86fa-340adfceabfd None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-cc6052cc-63bf-4517-86fa-340adfceabfd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:14.987103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:14.988053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:12:14.989353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:14.993132 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 333/663] 10.222.0.100 () {56 vars in 1134 bytes} [Tue Jul 26 15:12:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:14.994139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6052cc-63bf-4517-86fa-340adfceabfd None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:14.999195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcc20a-6a9f-475f-9ef4-35a6c3c015a2 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:15.036593 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cd92e-a2ee-4245-b482-8b07c3065f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:15.037478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cd92e-a2ee-4245-b482-8b07c3065f85 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:15.037903 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cd92e-a2ee-4245-b482-8b07c3065f85 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:15.038320 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cd92e-a2ee-4245-b482-8b07c3065f85 None admin] PATH_INFO: `/v3/services/network` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:15.039184 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cd92e-a2ee-4245-b482-8b07c3065f85 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:15.041105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cd92e-a2ee-4245-b482-8b07c3065f85 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-255cd92e-a2ee-4245-b482-8b07c3065f85 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:15.050624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:15.051638 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:12:15.052513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:15.058322 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 331/664] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:14 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:15.059090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:15.059990 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cd92e-a2ee-4245-b482-8b07c3065f85 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:15.075883 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:15.107641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6052cc-63bf-4517-86fa-340adfceabfd None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:15.144752 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb512cc-485c-4e0f-95b5-64aeadb54957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:15.145378 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb512cc-485c-4e0f-95b5-64aeadb54957 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:15.145678 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb512cc-485c-4e0f-95b5-64aeadb54957 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:15.145937 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb512cc-485c-4e0f-95b5-64aeadb54957 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:15.146621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb512cc-485c-4e0f-95b5-64aeadb54957 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:15.146926 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb512cc-485c-4e0f-95b5-64aeadb54957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:15.148342 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb512cc-485c-4e0f-95b5-64aeadb54957 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:15.154568 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 334/665] 10.222.0.100 () {56 vars in 1129 bytes} [Tue Jul 26 15:12:14 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:15.159321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb512cc-485c-4e0f-95b5-64aeadb54957 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:15.170427 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cd92e-a2ee-4245-b482-8b07c3065f85 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:15.214286 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afe03a-40ce-4a6a-ab5f-dbf9749f7675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:15.215337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afe03a-40ce-4a6a-ab5f-dbf9749f7675 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:15.215840 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afe03a-40ce-4a6a-ab5f-dbf9749f7675 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:15.216349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afe03a-40ce-4a6a-ab5f-dbf9749f7675 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:15.217229 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afe03a-40ce-4a6a-ab5f-dbf9749f7675 None admin] RBAC: Adding query filter params (name=network) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:15.217792 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afe03a-40ce-4a6a-ab5f-dbf9749f7675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:15.219429 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afe03a-40ce-4a6a-ab5f-dbf9749f7675 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:15.229633 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 332/666] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:15 2022] GET /identity/v3/services?name=network => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:15.231092 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afe03a-40ce-4a6a-ab5f-dbf9749f7675 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:15.273056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb512cc-485c-4e0f-95b5-64aeadb54957 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:15.297071 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:15.309070 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d2efb-0b3f-48ad-aaca-d469323f97b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:15.309696 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d2efb-0b3f-48ad-aaca-d469323f97b0 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:15.310219 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d2efb-0b3f-48ad-aaca-d469323f97b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:15.310506 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d2efb-0b3f-48ad-aaca-d469323f97b0 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:15.311189 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d2efb-0b3f-48ad-aaca-d469323f97b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:15.311500 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d2efb-0b3f-48ad-aaca-d469323f97b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:15.313063 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d2efb-0b3f-48ad-aaca-d469323f97b0 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:15.320726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:15.324412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 335/667] 10.222.0.100 () {56 vars in 1129 bytes} [Tue Jul 26 15:12:15 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:15.350415 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afe03a-40ce-4a6a-ab5f-dbf9749f7675 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:15.390587 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c98e4-7cca-4cd1-8c21-dbf13c329560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:15.391598 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c98e4-7cca-4cd1-8c21-dbf13c329560 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:15.392151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c98e4-7cca-4cd1-8c21-dbf13c329560 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:15.392689 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c98e4-7cca-4cd1-8c21-dbf13c329560 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:15.394106 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c98e4-7cca-4cd1-8c21-dbf13c329560 None admin] RBAC: Adding query filter params (type=network) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:15.394612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c98e4-7cca-4cd1-8c21-dbf13c329560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:15.396262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c98e4-7cca-4cd1-8c21-dbf13c329560 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:15.408325 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 333/668] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:15 2022] GET /identity/v3/services?type=network => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:16.331859 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fe14-ed55-49db-820e-2bb1d5c780eb None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:16.332427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fe14-ed55-49db-820e-2bb1d5c780eb None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:16.332427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fe14-ed55-49db-820e-2bb1d5c780eb None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:16.334011 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 336/669] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:16.339188 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7619d-8d8d-4fc7-9684-0afc4794dc43 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:16.339574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7619d-8d8d-4fc7-9684-0afc4794dc43 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:16.339738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7619d-8d8d-4fc7-9684-0afc4794dc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:16.358141 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-e5d7619d-8d8d-4fc7-9684-0afc4794dc43 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:16.359326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e5d7619d-8d8d-4fc7-9684-0afc4794dc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:16.437954 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 334/670] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:16.462618 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6fe14-ed55-49db-820e-2bb1d5c780eb None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:16.595040 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6fe14-ed55-49db-820e-2bb1d5c780eb None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:16.625246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83541327-a4fd-419f-ae9c-c7f3b5ec9f71 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:16.625910 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83541327-a4fd-419f-ae9c-c7f3b5ec9f71 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:16.626391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83541327-a4fd-419f-ae9c-c7f3b5ec9f71 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:16.628251 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 335/671] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:12:16.631964 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85426c6-f269-4ce7-868f-733883b33bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:16.632647 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85426c6-f269-4ce7-868f-733883b33bec None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:16.632935 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85426c6-f269-4ce7-868f-733883b33bec None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:16.633210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85426c6-f269-4ce7-868f-733883b33bec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:16.634448 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8c14-931f-4edc-b977-80f06c3ab957 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:16.634934 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8c14-931f-4edc-b977-80f06c3ab957 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:16.635408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8c14-931f-4edc-b977-80f06c3ab957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:16.648166 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85426c6-f269-4ce7-868f-733883b33bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-a85426c6-f269-4ce7-868f-733883b33bec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:16.650789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:16.651714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:16.652822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 337/672] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:16.660235 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85426c6-f269-4ce7-868f-733883b33bec None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:16.661917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b43f8c14-931f-4edc-b977-80f06c3ab957 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:16.664194 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b43f8c14-931f-4edc-b977-80f06c3ab957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:16.711129 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:16.755673 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:16.763087 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 336/673] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 15:12:16.773653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85426c6-f269-4ce7-868f-733883b33bec None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:16.786024 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f8c14-931f-4edc-b977-80f06c3ab957 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:16.826000 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edc2d8-d811-4255-ba39-eb05dffe840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:16.827288 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc2d8-d811-4255-ba39-eb05dffe840e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:16.827986 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc2d8-d811-4255-ba39-eb05dffe840e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:16.828500 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc2d8-d811-4255-ba39-eb05dffe840e None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:16.830032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edc2d8-d811-4255-ba39-eb05dffe840e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:16.831176 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edc2d8-d811-4255-ba39-eb05dffe840e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:16.832835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edc2d8-d811-4255-ba39-eb05dffe840e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:16.846079 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 338/674] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:12:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:16.851604 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edc2d8-d811-4255-ba39-eb05dffe840e None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:16.930251 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f8c14-931f-4edc-b977-80f06c3ab957 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:16.974646 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edc2d8-d811-4255-ba39-eb05dffe840e None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:16.978267 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bd16b-44ec-47a6-82d2-07357d1f7e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:16.979183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd16b-44ec-47a6-82d2-07357d1f7e2b None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:16.979661 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd16b-44ec-47a6-82d2-07357d1f7e2b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:16.980188 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd16b-44ec-47a6-82d2-07357d1f7e2b None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:16.981082 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bd16b-44ec-47a6-82d2-07357d1f7e2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:16.983260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bd16b-44ec-47a6-82d2-07357d1f7e2b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:16.985075 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:17.011095 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301634a5-336d-4809-9ee3-05cf9ea575f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:17.012327 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301634a5-336d-4809-9ee3-05cf9ea575f2 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.013070 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301634a5-336d-4809-9ee3-05cf9ea575f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.013593 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301634a5-336d-4809-9ee3-05cf9ea575f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.025472 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301634a5-336d-4809-9ee3-05cf9ea575f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:17.026938 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301634a5-336d-4809-9ee3-05cf9ea575f2 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-301634a5-336d-4809-9ee3-05cf9ea575f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:17.042951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:17.043928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:17.049898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:17.049898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:17.049898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:17.049898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:17.049898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 339/675] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:17.055047 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301634a5-336d-4809-9ee3-05cf9ea575f2 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:17.132434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 337/676] 10.222.0.100 () {60 vars in 1146 bytes} [Tue Jul 26 15:12:16 2022] POST /identity/v3/services => generated 243 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:12:17.195994 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301634a5-336d-4809-9ee3-05cf9ea575f2 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:17.245742 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ca026-897f-49e5-b21d-f2bbf59e30cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:17.246882 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ca026-897f-49e5-b21d-f2bbf59e30cd None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.247389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ca026-897f-49e5-b21d-f2bbf59e30cd None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.248001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ca026-897f-49e5-b21d-f2bbf59e30cd None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.249039 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ca026-897f-49e5-b21d-f2bbf59e30cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:17.249570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ca026-897f-49e5-b21d-f2bbf59e30cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:17.251351 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ca026-897f-49e5-b21d-f2bbf59e30cd None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:17.267411 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 340/677] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:17.272893 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bd16b-44ec-47a6-82d2-07357d1f7e2b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:17.351146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:17.400451 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bd16b-44ec-47a6-82d2-07357d1f7e2b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:17.437426 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5b910-5aaa-42ac-ad4e-527468595b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:17.438076 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5b910-5aaa-42ac-ad4e-527468595b3f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.438365 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5b910-5aaa-42ac-ad4e-527468595b3f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.438646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5b910-5aaa-42ac-ad4e-527468595b3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.447577 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5b910-5aaa-42ac-ad4e-527468595b3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:17.449003 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5b910-5aaa-42ac-ad4e-527468595b3f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-cfd5b910-5aaa-42ac-ad4e-527468595b3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:17.462845 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:17.463929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:17.465065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 338/678] 10.222.0.100 () {56 vars in 1098 bytes} [Tue Jul 26 15:12:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:17.470224 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ca026-897f-49e5-b21d-f2bbf59e30cd None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:17.511903 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:17.620258 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ca026-897f-49e5-b21d-f2bbf59e30cd None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:17.660244 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcde48-6255-4723-b18f-dffe0706e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:17.660795 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcde48-6255-4723-b18f-dffe0706e193 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.661079 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcde48-6255-4723-b18f-dffe0706e193 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.661356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcde48-6255-4723-b18f-dffe0706e193 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.662165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcde48-6255-4723-b18f-dffe0706e193 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:17.662475 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcde48-6255-4723-b18f-dffe0706e193 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:17.663922 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcde48-6255-4723-b18f-dffe0706e193 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:17.688579 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 341/679] 10.222.0.100 () {56 vars in 1138 bytes} [Tue Jul 26 15:12:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:17.694594 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5b910-5aaa-42ac-ad4e-527468595b3f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:17.698893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742250-eb0c-4a72-a446-72e46723bc2b None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.699182 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742250-eb0c-4a72-a446-72e46723bc2b None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.699463 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742250-eb0c-4a72-a446-72e46723bc2b None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.701077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 342/680] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:17.710141 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc167-d998-451c-8318-69275b50604e None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.710427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc167-d998-451c-8318-69275b50604e None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.710710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc167-d998-451c-8318-69275b50604e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.728665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-eb0fc167-d998-451c-8318-69275b50604e None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:17.729835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-eb0fc167-d998-451c-8318-69275b50604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:17.805452 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 343/681] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:17 2022] POST /identity/v3/auth/tokens => generated 896 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:17.806746 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7071540-610f-4ada-86c1-e4b976290844 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.807032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7071540-610f-4ada-86c1-e4b976290844 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.807138 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5b910-5aaa-42ac-ad4e-527468595b3f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:17.807306 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7071540-610f-4ada-86c1-e4b976290844 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.812337 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 344/682] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:17 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:17.815414 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dae11-53f8-48fd-be51-e559865c6ea0 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.815872 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dae11-53f8-48fd-be51-e559865c6ea0 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.816345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dae11-53f8-48fd-be51-e559865c6ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.824019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:17.836266 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:17.836667 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-298dae11-53f8-48fd-be51-e559865c6ea0 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:17.837881 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-298dae11-53f8-48fd-be51-e559865c6ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:17.851178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaffc0-a104-4a11-abfc-351de5bdee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:17.855617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaffc0-a104-4a11-abfc-351de5bdee48 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:17.855617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaffc0-a104-4a11-abfc-351de5bdee48 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:17.855617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaffc0-a104-4a11-abfc-351de5bdee48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:17.864421 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaffc0-a104-4a11-abfc-351de5bdee48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:17.865892 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaffc0-a104-4a11-abfc-351de5bdee48 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-5fcaffc0-a104-4a11-abfc-351de5bdee48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:17.881947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:17.888826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:17.889740 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:17.889740 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:17.889740 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:17.889740 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:17.889740 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 339/683] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:17.889740 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaffc0-a104-4a11-abfc-351de5bdee48 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:17.916222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 345/684] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:17 2022] POST /identity/v3/auth/tokens => generated 896 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:17.916222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dae11-53f8-48fd-be51-e559865c6ea0 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:18.014754 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaffc0-a104-4a11-abfc-351de5bdee48 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:18.020489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dae11-53f8-48fd-be51-e559865c6ea0 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:18.052584 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f447e9a-95cd-4f19-a9fe-1ab74c7c4e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:18.053472 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f447e9a-95cd-4f19-a9fe-1ab74c7c4e33 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:18.053863 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f447e9a-95cd-4f19-a9fe-1ab74c7c4e33 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:18.054244 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f447e9a-95cd-4f19-a9fe-1ab74c7c4e33 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:18.054945 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f447e9a-95cd-4f19-a9fe-1ab74c7c4e33 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:18.056495 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f447e9a-95cd-4f19-a9fe-1ab74c7c4e33 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:18.057822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038f802-2928-44f0-9dc2-02f70e42ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:18.058625 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038f802-2928-44f0-9dc2-02f70e42ff73 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:18.059087 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038f802-2928-44f0-9dc2-02f70e42ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:18.059510 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038f802-2928-44f0-9dc2-02f70e42ff73 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:18.060833 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038f802-2928-44f0-9dc2-02f70e42ff73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:18.066210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038f802-2928-44f0-9dc2-02f70e42ff73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:18.066210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038f802-2928-44f0-9dc2-02f70e42ff73 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:18.066210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:18.076340 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 346/685] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:18.077139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038f802-2928-44f0-9dc2-02f70e42ff73 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:18.149643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 340/686] 10.222.0.100 () {60 vars in 1146 bytes} [Tue Jul 26 15:12:17 2022] POST /identity/v3/services => generated 252 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:12:18.153192 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f447e9a-95cd-4f19-a9fe-1ab74c7c4e33 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:18.190353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038f802-2928-44f0-9dc2-02f70e42ff73 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:18.209215 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:18.239299 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f04b37-e4ea-432b-9a18-695e742b3203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:18.239933 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f04b37-e4ea-432b-9a18-695e742b3203 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:18.240293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f04b37-e4ea-432b-9a18-695e742b3203 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:18.240579 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f04b37-e4ea-432b-9a18-695e742b3203 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:18.241277 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f04b37-e4ea-432b-9a18-695e742b3203 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:18.242777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f04b37-e4ea-432b-9a18-695e742b3203 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:18.297991 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f447e9a-95cd-4f19-a9fe-1ab74c7c4e33 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:18.342161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b0b4-be94-4996-9cb1-bab994869a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:18.342837 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b0b4-be94-4996-9cb1-bab994869a9a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:18.343102 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b0b4-be94-4996-9cb1-bab994869a9a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:18.343357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b0b4-be94-4996-9cb1-bab994869a9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:18.350885 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5b0b4-be94-4996-9cb1-bab994869a9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:18.352629 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5b0b4-be94-4996-9cb1-bab994869a9a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:18.357379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 347/687] 10.222.0.100 () {60 vars in 1146 bytes} [Tue Jul 26 15:12:18 2022] POST /identity/v3/services => generated 241 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-14a5b0b4-be94-4996-9cb1-bab994869a9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:18.365339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:18.366370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:18.367712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:18.367712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:18.367712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:18.367712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:18.367712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:18.367712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:18.367712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:18.367712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:18.367712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 341/688] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:18.375513 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f04b37-e4ea-432b-9a18-695e742b3203 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:18.443207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:18.516963 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f04b37-e4ea-432b-9a18-695e742b3203 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:18.563851 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc1a8b-94fc-4ef7-bf18-d7771bf6e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:18.564585 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1a8b-94fc-4ef7-bf18-d7771bf6e960 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:18.565364 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1a8b-94fc-4ef7-bf18-d7771bf6e960 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:18.565641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1a8b-94fc-4ef7-bf18-d7771bf6e960 None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:18.566399 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc1a8b-94fc-4ef7-bf18-d7771bf6e960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:18.566731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc1a8b-94fc-4ef7-bf18-d7771bf6e960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:18.569958 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc1a8b-94fc-4ef7-bf18-d7771bf6e960 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:18.588156 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 348/689] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:18.594490 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b0b4-be94-4996-9cb1-bab994869a9a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:18.699893 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:18.709920 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b0b4-be94-4996-9cb1-bab994869a9a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:18.744763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da154f8-ebc9-473e-b2a1-4a46568ffffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:18.745818 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da154f8-ebc9-473e-b2a1-4a46568ffffd None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:18.746367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da154f8-ebc9-473e-b2a1-4a46568ffffd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:18.746858 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da154f8-ebc9-473e-b2a1-4a46568ffffd None admin] PATH_INFO: `/v3/projects/7bc4375bb14d42199565b224bef1242c/users/dcc3cee241bd45c49e37124cc4dd6e34/roles/6d23401ca57e47398bf036ea320a7617` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:18.749503 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da154f8-ebc9-473e-b2a1-4a46568ffffd None admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4375bb14d42199565b224bef1242c, user_id=dcc3cee241bd45c49e37124cc4dd6e34, role_id=6d23401ca57e47398bf036ea320a7617)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:18.751252 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da154f8-ebc9-473e-b2a1-4a46568ffffd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:18.854406 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 342/690] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:12:18 2022] PUT /identity/v3/projects/7bc4375bb14d42199565b224bef1242c/users/dcc3cee241bd45c49e37124cc4dd6e34/roles/6d23401ca57e47398bf036ea320a7617 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:12:19.708426 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc5cc-affc-49f6-a36c-59b0b130b4d3 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:19.709078 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc5cc-affc-49f6-a36c-59b0b130b4d3 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:19.709078 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bc5cc-affc-49f6-a36c-59b0b130b4d3 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:19.710840 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 349/691] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:19.716389 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8ac6e-6136-4605-9923-7f5bb22433b0 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:19.716931 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8ac6e-6136-4605-9923-7f5bb22433b0 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:19.716931 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8ac6e-6136-4605-9923-7f5bb22433b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:19.739174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-dbb8ac6e-6136-4605-9923-7f5bb22433b0 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:19.740482 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-dbb8ac6e-6136-4605-9923-7f5bb22433b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:19.822820 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 343/692] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:19 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:19.847849 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bc5cc-affc-49f6-a36c-59b0b130b4d3 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:19.977658 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991bc5cc-affc-49f6-a36c-59b0b130b4d3 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:19.986139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:20.024623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a727f-440f-40b1-a4e2-1452ef7e198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:20.025185 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a727f-440f-40b1-a4e2-1452ef7e198e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:20.025475 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a727f-440f-40b1-a4e2-1452ef7e198e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:20.025759 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a727f-440f-40b1-a4e2-1452ef7e198e None admin] PATH_INFO: `/v3/services/image` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:20.026536 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a727f-440f-40b1-a4e2-1452ef7e198e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:20.028058 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8a727f-440f-40b1-a4e2-1452ef7e198e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-5a8a727f-440f-40b1-a4e2-1452ef7e198e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:20.038633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:20.039792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:20.040697 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 350/693] 10.222.0.100 () {56 vars in 1110 bytes} [Tue Jul 26 15:12:19 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:20.050651 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8ac6e-6136-4605-9923-7f5bb22433b0 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:20.147433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:20.170923 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8ac6e-6136-4605-9923-7f5bb22433b0 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:20.208844 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc721c-23c8-4125-85b6-ed0bbdc01e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:20.209529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc721c-23c8-4125-85b6-ed0bbdc01e0b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:20.209815 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc721c-23c8-4125-85b6-ed0bbdc01e0b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:20.210099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc721c-23c8-4125-85b6-ed0bbdc01e0b None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:20.211937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc721c-23c8-4125-85b6-ed0bbdc01e0b None admin] RBAC: Adding query filter params (name=image) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:20.212295 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc721c-23c8-4125-85b6-ed0bbdc01e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:20.213676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc721c-23c8-4125-85b6-ed0bbdc01e0b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:20.218867 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 344/694] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:20 2022] GET /identity/v3/services?name=image => generated 123 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:20.224516 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a727f-440f-40b1-a4e2-1452ef7e198e None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:20.333274 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a727f-440f-40b1-a4e2-1452ef7e198e None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:20.375132 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34374e-0fe2-4ab5-ab8a-700911622811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:20.376495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34374e-0fe2-4ab5-ab8a-700911622811 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:20.377094 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34374e-0fe2-4ab5-ab8a-700911622811 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:20.378073 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34374e-0fe2-4ab5-ab8a-700911622811 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:20.378971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34374e-0fe2-4ab5-ab8a-700911622811 None admin] RBAC: Adding query filter params (type=image) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:20.379494 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34374e-0fe2-4ab5-ab8a-700911622811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:20.381112 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34374e-0fe2-4ab5-ab8a-700911622811 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:20.387228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 351/695] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:20 2022] GET /identity/v3/services?type=image => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:20.396267 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc721c-23c8-4125-85b6-ed0bbdc01e0b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:20.509490 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc721c-23c8-4125-85b6-ed0bbdc01e0b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:20.545900 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7e9e-c39b-42a8-a8c4-a1e56e7d7514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:20.546524 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7e9e-c39b-42a8-a8c4-a1e56e7d7514 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:20.546811 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7e9e-c39b-42a8-a8c4-a1e56e7d7514 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:20.547091 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7e9e-c39b-42a8-a8c4-a1e56e7d7514 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:20.547844 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7e9e-c39b-42a8-a8c4-a1e56e7d7514 None admin] RBAC: Adding query filter params (interface=public, service_id=9fe52e1454804bfc8709407795b33975, region_id=RegionOne) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:20.548197 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7e9e-c39b-42a8-a8c4-a1e56e7d7514 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:20.550134 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7e9e-c39b-42a8-a8c4-a1e56e7d7514 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:20.559430 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 345/696] 10.222.0.100 () {56 vars in 1256 bytes} [Tue Jul 26 15:12:20 2022] GET /identity/v3/endpoints?service_id=9fe52e1454804bfc8709407795b33975&interface=public®ion_id=RegionOne => generated 195 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:20.564944 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34374e-0fe2-4ab5-ab8a-700911622811 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:20.602339 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:20.672050 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34374e-0fe2-4ab5-ab8a-700911622811 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:20.714630 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be19a8-e6d2-4b20-89a3-aa1e5ffd1458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:20.716102 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be19a8-e6d2-4b20-89a3-aa1e5ffd1458 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:20.716627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be19a8-e6d2-4b20-89a3-aa1e5ffd1458 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:20.717161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be19a8-e6d2-4b20-89a3-aa1e5ffd1458 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:20.718037 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be19a8-e6d2-4b20-89a3-aa1e5ffd1458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:20.719666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be19a8-e6d2-4b20-89a3-aa1e5ffd1458 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:20.726919 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 352/697] 10.222.0.100 () {56 vars in 1092 bytes} [Tue Jul 26 15:12:20 2022] GET /identity/v3/services => generated 1007 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:12:20.851176 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01019-bd5f-4c4c-8005-456815891b17 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:20.851714 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01019-bd5f-4c4c-8005-456815891b17 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:20.851802 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01019-bd5f-4c4c-8005-456815891b17 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:20.854498 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 346/698] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:20.860299 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63800-3e45-4506-8127-bcfa322355e8 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:20.861698 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63800-3e45-4506-8127-bcfa322355e8 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:20.861698 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a63800-3e45-4506-8127-bcfa322355e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:20.880674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-12a63800-3e45-4506-8127-bcfa322355e8 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:20.881874 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-12a63800-3e45-4506-8127-bcfa322355e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:20.925559 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3966c-3b40-409f-a84e-30140a311575 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:20.925856 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3966c-3b40-409f-a84e-30140a311575 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:20.926141 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3966c-3b40-409f-a84e-30140a311575 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:20.928694 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 347/699] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:12:20.932506 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a2c4d-dcb4-485f-a691-37415a675b2e None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:20.932848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a2c4d-dcb4-485f-a691-37415a675b2e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:20.933193 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a2c4d-dcb4-485f-a691-37415a675b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:20.953423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-fd1a2c4d-dcb4-485f-a691-37415a675b2e None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:20.954712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-fd1a2c4d-dcb4-485f-a691-37415a675b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:20.958341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:20.975468 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 353/700] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:20 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:21.008289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63800-3e45-4506-8127-bcfa322355e8 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.032532 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 348/701] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:20 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:21.049771 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:21.058437 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a2c4d-dcb4-485f-a691-37415a675b2e None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.131190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a63800-3e45-4506-8127-bcfa322355e8 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:21.169466 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ead83-808c-4c17-b59a-ffeecea8dabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:21.170620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ead83-808c-4c17-b59a-ffeecea8dabf None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.171106 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ead83-808c-4c17-b59a-ffeecea8dabf None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.171594 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ead83-808c-4c17-b59a-ffeecea8dabf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.172454 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ead83-808c-4c17-b59a-ffeecea8dabf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:21.174381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ead83-808c-4c17-b59a-ffeecea8dabf None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:21.176170 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a2c4d-dcb4-485f-a691-37415a675b2e None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-824ead83-808c-4c17-b59a-ffeecea8dabf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:21.184060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:21.185016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:12:21.185971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:21.188912 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 354/702] 10.222.0.100 () {56 vars in 1134 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:21.194926 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ead83-808c-4c17-b59a-ffeecea8dabf None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.229265 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28427ce-bf84-46f8-8c14-4619f859e2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:21.230281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28427ce-bf84-46f8-8c14-4619f859e2d1 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.230563 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28427ce-bf84-46f8-8c14-4619f859e2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.230833 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28427ce-bf84-46f8-8c14-4619f859e2d1 None admin] PATH_INFO: `/v3/services/network` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.231512 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28427ce-bf84-46f8-8c14-4619f859e2d1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:21.233196 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28427ce-bf84-46f8-8c14-4619f859e2d1 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-a28427ce-bf84-46f8-8c14-4619f859e2d1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:21.245787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:21.246836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:21.247685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 349/703] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:21.256464 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28427ce-bf84-46f8-8c14-4619f859e2d1 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.264404 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:21.312090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:21.321226 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ead83-808c-4c17-b59a-ffeecea8dabf None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:21.356739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c1c11-7ced-47c9-9154-06cd9f2bfd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:21.357547 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c1c11-7ced-47c9-9154-06cd9f2bfd6e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.357944 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c1c11-7ced-47c9-9154-06cd9f2bfd6e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.358218 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c1c11-7ced-47c9-9154-06cd9f2bfd6e None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.358890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c1c11-7ced-47c9-9154-06cd9f2bfd6e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:21.359192 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c1c11-7ced-47c9-9154-06cd9f2bfd6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:21.360720 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c1c11-7ced-47c9-9154-06cd9f2bfd6e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:21.370328 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 355/704] 10.222.0.100 () {56 vars in 1129 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:21.370494 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28427ce-bf84-46f8-8c14-4619f859e2d1 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:21.370672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020b13d-7206-4663-8479-661efef2079b None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.370672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020b13d-7206-4663-8479-661efef2079b None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.370672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020b13d-7206-4663-8479-661efef2079b None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.370672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 356/705] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:21.371231 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020b13d-7206-4663-8479-661efef2079b None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.409181 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f87f31-98e5-482a-95e4-ffbcf447bf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:21.409711 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f87f31-98e5-482a-95e4-ffbcf447bf75 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.409990 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f87f31-98e5-482a-95e4-ffbcf447bf75 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.410263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f87f31-98e5-482a-95e4-ffbcf447bf75 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.411066 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f87f31-98e5-482a-95e4-ffbcf447bf75 None admin] RBAC: Adding query filter params (name=network) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:21.411235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f87f31-98e5-482a-95e4-ffbcf447bf75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:21.412669 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f87f31-98e5-482a-95e4-ffbcf447bf75 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:21.418840 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 350/706] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/services?name=network => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:21.420648 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf61e-475e-431b-80c9-19e8f39e03e0 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.420957 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf61e-475e-431b-80c9-19e8f39e03e0 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.421240 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1cf61e-475e-431b-80c9-19e8f39e03e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.440010 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-2b1cf61e-475e-431b-80c9-19e8f39e03e0 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:21.441211 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-2b1cf61e-475e-431b-80c9-19e8f39e03e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:21.498280 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020b13d-7206-4663-8479-661efef2079b None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:21.519665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:21.536144 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 351/707] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:21 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:21.536144 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cf61e-475e-431b-80c9-19e8f39e03e0 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.550253 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47572995-fa44-4af7-acaa-9048f4c7664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:21.550926 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47572995-fa44-4af7-acaa-9048f4c7664f None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.551205 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47572995-fa44-4af7-acaa-9048f4c7664f None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.551478 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47572995-fa44-4af7-acaa-9048f4c7664f None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.552238 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47572995-fa44-4af7-acaa-9048f4c7664f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:21.552546 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47572995-fa44-4af7-acaa-9048f4c7664f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:21.557437 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47572995-fa44-4af7-acaa-9048f4c7664f None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:21.559892 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 357/708] 10.222.0.100 () {56 vars in 1129 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:21.564176 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47572995-fa44-4af7-acaa-9048f4c7664f None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.584994 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:21.642007 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1cf61e-475e-431b-80c9-19e8f39e03e0 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:21.668456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47572995-fa44-4af7-acaa-9048f4c7664f None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:21.678727 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2466fa5-2d83-4cfa-9320-7e6a2ab61d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:21.679989 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2466fa5-2d83-4cfa-9320-7e6a2ab61d1c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.680728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2466fa5-2d83-4cfa-9320-7e6a2ab61d1c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.681195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2466fa5-2d83-4cfa-9320-7e6a2ab61d1c None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.682198 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2466fa5-2d83-4cfa-9320-7e6a2ab61d1c None admin] RBAC: Adding query filter params (type=network) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:21.682685 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2466fa5-2d83-4cfa-9320-7e6a2ab61d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:21.684856 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2466fa5-2d83-4cfa-9320-7e6a2ab61d1c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:21.692407 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 352/709] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/services?type=network => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:21.693917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2466fa5-2d83-4cfa-9320-7e6a2ab61d1c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.704722 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc109d-28ca-47ab-88c6-205bcba94966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:21.705791 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc109d-28ca-47ab-88c6-205bcba94966 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.706079 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc109d-28ca-47ab-88c6-205bcba94966 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.706361 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc109d-28ca-47ab-88c6-205bcba94966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.717712 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc109d-28ca-47ab-88c6-205bcba94966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-f9bc109d-28ca-47ab-88c6-205bcba94966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:12:21.722615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:21.723564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:21.724449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 358/710] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:21.725858 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc109d-28ca-47ab-88c6-205bcba94966 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.768238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:21.806495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:21.810019 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2466fa5-2d83-4cfa-9320-7e6a2ab61d1c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:21.827434 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc109d-28ca-47ab-88c6-205bcba94966 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:21.847706 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992621b-b710-4c1a-8d85-c410ccca625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:21.848364 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992621b-b710-4c1a-8d85-c410ccca625a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.848647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992621b-b710-4c1a-8d85-c410ccca625a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.848946 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992621b-b710-4c1a-8d85-c410ccca625a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.849680 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992621b-b710-4c1a-8d85-c410ccca625a None admin] RBAC: Adding query filter params (interface=public, service_id=1059a48178a741bcbced093f5ddea7cc, region_id=RegionOne) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:21.849995 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992621b-b710-4c1a-8d85-c410ccca625a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:21.851366 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992621b-b710-4c1a-8d85-c410ccca625a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:21.860510 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 353/711] 10.222.0.100 () {56 vars in 1256 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/endpoints?service_id=1059a48178a741bcbced093f5ddea7cc&interface=public®ion_id=RegionOne => generated 195 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:21.861960 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992621b-b710-4c1a-8d85-c410ccca625a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.866149 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f563d72-112c-4f8f-a0c0-8bf3c2993a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:21.866768 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f563d72-112c-4f8f-a0c0-8bf3c2993a06 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:21.867047 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f563d72-112c-4f8f-a0c0-8bf3c2993a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:21.867319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f563d72-112c-4f8f-a0c0-8bf3c2993a06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:21.868153 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f563d72-112c-4f8f-a0c0-8bf3c2993a06 None admin] RBAC: Adding query filter params (interface=public, service_id=e2a4e0e829724872b246a55ed47ccbc4, region_id=RegionOne) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:21.868463 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f563d72-112c-4f8f-a0c0-8bf3c2993a06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:21.869845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f563d72-112c-4f8f-a0c0-8bf3c2993a06 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:21.883373 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 359/712] 10.222.0.100 () {56 vars in 1256 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/endpoints?service_id=e2a4e0e829724872b246a55ed47ccbc4&interface=public®ion_id=RegionOne => generated 195 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:21.883373 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f563d72-112c-4f8f-a0c0-8bf3c2993a06 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:21.978314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992621b-b710-4c1a-8d85-c410ccca625a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:21.998160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f563d72-112c-4f8f-a0c0-8bf3c2993a06 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:22.004489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:22.014165 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55de6-5b5e-422b-9153-58f70cb2e145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:22.022708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55de6-5b5e-422b-9153-58f70cb2e145 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:22.022708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55de6-5b5e-422b-9153-58f70cb2e145 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:22.022708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55de6-5b5e-422b-9153-58f70cb2e145 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:22.022708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b55de6-5b5e-422b-9153-58f70cb2e145 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:22.022708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b55de6-5b5e-422b-9153-58f70cb2e145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:22.022708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b55de6-5b5e-422b-9153-58f70cb2e145 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:22.026676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 354/713] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:22.027455 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55de6-5b5e-422b-9153-58f70cb2e145 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:22.041495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087c3b1-3511-4b1c-ba67-add038a8e70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:22.042401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c3b1-3511-4b1c-ba67-add038a8e70c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:22.042910 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c3b1-3511-4b1c-ba67-add038a8e70c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:22.043385 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c3b1-3511-4b1c-ba67-add038a8e70c None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:22.044281 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087c3b1-3511-4b1c-ba67-add038a8e70c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:22.045893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087c3b1-3511-4b1c-ba67-add038a8e70c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:22.052194 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 360/714] 10.222.0.100 () {56 vars in 1092 bytes} [Tue Jul 26 15:12:21 2022] GET /identity/v3/services => generated 1007 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:12:22.053259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087c3b1-3511-4b1c-ba67-add038a8e70c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:22.072661 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:22.154690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55de6-5b5e-422b-9153-58f70cb2e145 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:22.199190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b0c8-5928-4cf9-a62e-5783103a003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:22.200432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b0c8-5928-4cf9-a62e-5783103a003b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:22.200892 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b0c8-5928-4cf9-a62e-5783103a003b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:22.201961 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9b0c8-5928-4cf9-a62e-5783103a003b None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:22.203090 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9b0c8-5928-4cf9-a62e-5783103a003b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:22.204700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9b0c8-5928-4cf9-a62e-5783103a003b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:22.204892 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087c3b1-3511-4b1c-ba67-add038a8e70c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:22.216166 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 355/715] 10.222.0.100 () {56 vars in 1092 bytes} [Tue Jul 26 15:12:22 2022] GET /identity/v3/services => generated 1007 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:12:22.251358 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba376f9-81f6-4343-bc31-9a2f78030021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:22.252138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba376f9-81f6-4343-bc31-9a2f78030021 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:22.252541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba376f9-81f6-4343-bc31-9a2f78030021 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:22.252918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba376f9-81f6-4343-bc31-9a2f78030021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:22.265789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba376f9-81f6-4343-bc31-9a2f78030021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:22.267421 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba376f9-81f6-4343-bc31-9a2f78030021 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-8ba376f9-81f6-4343-bc31-9a2f78030021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:22.284876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:22.286046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:22.287158 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:22.287158 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:22.287158 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:22.287158 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:22.288808 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 361/716] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:22.294643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b0c8-5928-4cf9-a62e-5783103a003b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:22.363613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:22.419381 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9b0c8-5928-4cf9-a62e-5783103a003b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:22.457469 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569768c-4bd9-4b6f-8414-713e1dafbb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:22.458339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569768c-4bd9-4b6f-8414-713e1dafbb65 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:22.458771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569768c-4bd9-4b6f-8414-713e1dafbb65 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:22.459195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569768c-4bd9-4b6f-8414-713e1dafbb65 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:22.460036 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569768c-4bd9-4b6f-8414-713e1dafbb65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:22.460536 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569768c-4bd9-4b6f-8414-713e1dafbb65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:22.462062 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569768c-4bd9-4b6f-8414-713e1dafbb65 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:22.475929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 356/717] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:22.481030 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba376f9-81f6-4343-bc31-9a2f78030021 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:22.547403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:22.591175 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba376f9-81f6-4343-bc31-9a2f78030021 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:22.627779 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f5336-96d3-4980-b9d9-c3f2f7af1fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:22.628454 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f5336-96d3-4980-b9d9-c3f2f7af1fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:22.628741 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f5336-96d3-4980-b9d9-c3f2f7af1fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:22.629017 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f5336-96d3-4980-b9d9-c3f2f7af1fd5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:22.637284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f5336-96d3-4980-b9d9-c3f2f7af1fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:22.638759 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f5336-96d3-4980-b9d9-c3f2f7af1fd5 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-c79f5336-96d3-4980-b9d9-c3f2f7af1fd5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:22.651222 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:22.652305 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:22.653311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 362/718] 10.222.0.100 () {56 vars in 1098 bytes} [Tue Jul 26 15:12:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:22.660908 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569768c-4bd9-4b6f-8414-713e1dafbb65 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:22.765838 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569768c-4bd9-4b6f-8414-713e1dafbb65 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:22.780257 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:22.802501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ba5a-2b53-4797-99bc-7d891494d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:22.803459 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ba5a-2b53-4797-99bc-7d891494d00a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:22.803971 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ba5a-2b53-4797-99bc-7d891494d00a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:22.804502 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ba5a-2b53-4797-99bc-7d891494d00a None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:22.805561 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ba5a-2b53-4797-99bc-7d891494d00a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:22.806073 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ba5a-2b53-4797-99bc-7d891494d00a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:22.807754 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ba5a-2b53-4797-99bc-7d891494d00a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:22.832387 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 357/719] 10.222.0.100 () {56 vars in 1138 bytes} [Tue Jul 26 15:12:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:22.834536 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f5336-96d3-4980-b9d9-c3f2f7af1fd5 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:22.950190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f5336-96d3-4980-b9d9-c3f2f7af1fd5 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:22.972661 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:22.987817 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a77e7-6dff-4351-9b2d-cee163bfaa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:22.988487 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a77e7-6dff-4351-9b2d-cee163bfaa75 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:22.988824 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a77e7-6dff-4351-9b2d-cee163bfaa75 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:22.989104 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a77e7-6dff-4351-9b2d-cee163bfaa75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.031991 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b551aa6-67b7-4fad-bd36-67bc7fba04bd None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:23.032575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b551aa6-67b7-4fad-bd36-67bc7fba04bd None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:23.032669 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b551aa6-67b7-4fad-bd36-67bc7fba04bd None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.034184 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 358/720] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:12:23.039440 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be0bf-be8e-4241-a54a-c14eb2c3f744 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:23.039958 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be0bf-be8e-4241-a54a-c14eb2c3f744 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:23.040463 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be0bf-be8e-4241-a54a-c14eb2c3f744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.063840 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-975be0bf-be8e-4241-a54a-c14eb2c3f744 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:23.065748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-975be0bf-be8e-4241-a54a-c14eb2c3f744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:23.074072 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a77e7-6dff-4351-9b2d-cee163bfaa75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:23.076076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a77e7-6dff-4351-9b2d-cee163bfaa75 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:23.137677 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 359/721] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:23 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:12:23.161072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be0bf-be8e-4241-a54a-c14eb2c3f744 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:23.192931 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 363/722] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:12:22 2022] GET /identity/v3/auth/tokens => generated 1099 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:12:23.194034 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a77e7-6dff-4351-9b2d-cee163bfaa75 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:23.216729 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:23.278296 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:23.281390 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be0bf-be8e-4241-a54a-c14eb2c3f744 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:23.312553 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a77e7-6dff-4351-9b2d-cee163bfaa75 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:23.328719 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3c64-bbdc-4a48-8799-d00567309bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:23.329186 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3c64-bbdc-4a48-8799-d00567309bbf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:23.329472 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3c64-bbdc-4a48-8799-d00567309bbf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:23.329746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3c64-bbdc-4a48-8799-d00567309bbf None admin] PATH_INFO: `/v3/services/image` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.330438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3c64-bbdc-4a48-8799-d00567309bbf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:23.331812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3c64-bbdc-4a48-8799-d00567309bbf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-91da3c64-bbdc-4a48-8799-d00567309bbf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:23.342067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:23.343105 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 15:12:23.343937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:23.348381 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 360/723] 10.222.0.100 () {56 vars in 1110 bytes} [Tue Jul 26 15:12:23 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:23.349309 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3c64-bbdc-4a48-8799-d00567309bbf None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:23.356255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c1f9-8588-4b07-ba66-33a0f72c5e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:23.357237 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c1f9-8588-4b07-ba66-33a0f72c5e9c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:23.357959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c1f9-8588-4b07-ba66-33a0f72c5e9c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:23.358548 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01c1f9-8588-4b07-ba66-33a0f72c5e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.371797 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01c1f9-8588-4b07-ba66-33a0f72c5e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:23.374077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01c1f9-8588-4b07-ba66-33a0f72c5e9c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-dc01c1f9-8588-4b07-ba66-33a0f72c5e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:23.391733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:23.392772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:23.393657 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:23.393657 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:23.393657 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:23.393657 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:23.395990 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 364/724] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:23.401507 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c1f9-8588-4b07-ba66-33a0f72c5e9c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:23.458132 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3c64-bbdc-4a48-8799-d00567309bbf None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:23.495413 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:23.495953 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881ff9-d5f4-4528-8185-7c2e8a6162a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:23.496360 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881ff9-d5f4-4528-8185-7c2e8a6162a7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:23.496642 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881ff9-d5f4-4528-8185-7c2e8a6162a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:23.496918 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881ff9-d5f4-4528-8185-7c2e8a6162a7 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.497597 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9881ff9-d5f4-4528-8185-7c2e8a6162a7 None admin] RBAC: Adding query filter params (name=image) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:23.497903 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9881ff9-d5f4-4528-8185-7c2e8a6162a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:23.499275 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9881ff9-d5f4-4528-8185-7c2e8a6162a7 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:23.509295 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 361/725] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:23 2022] GET /identity/v3/services?name=image => generated 123 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:23.510234 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881ff9-d5f4-4528-8185-7c2e8a6162a7 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:23.532634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01c1f9-8588-4b07-ba66-33a0f72c5e9c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:23.539473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:23.571073 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dc987-bab5-4659-a227-d03f3d0b5616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:23.572038 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc987-bab5-4659-a227-d03f3d0b5616 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:23.572595 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc987-bab5-4659-a227-d03f3d0b5616 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:23.573093 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033dc987-bab5-4659-a227-d03f3d0b5616 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.573969 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dc987-bab5-4659-a227-d03f3d0b5616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:23.574467 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dc987-bab5-4659-a227-d03f3d0b5616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:23.576273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033dc987-bab5-4659-a227-d03f3d0b5616 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:23.595514 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 365/726] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:23.596867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dc987-bab5-4659-a227-d03f3d0b5616 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:23.613706 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881ff9-d5f4-4528-8185-7c2e8a6162a7 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:23.649713 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ace00-f160-4791-be10-7f336ea50056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:23.650325 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ace00-f160-4791-be10-7f336ea50056 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:23.650608 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ace00-f160-4791-be10-7f336ea50056 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:23.650878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ace00-f160-4791-be10-7f336ea50056 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.651550 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ace00-f160-4791-be10-7f336ea50056 None admin] RBAC: Adding query filter params (type=image) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:23.651857 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ace00-f160-4791-be10-7f336ea50056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:23.653254 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ace00-f160-4791-be10-7f336ea50056 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:23.662982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 362/727] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:23 2022] GET /identity/v3/services?type=image => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:23.663902 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ace00-f160-4791-be10-7f336ea50056 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:23.707396 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033dc987-bab5-4659-a227-d03f3d0b5616 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:23.743928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02bd3c-7d97-4796-8685-ea2eb44a28d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:23.745138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02bd3c-7d97-4796-8685-ea2eb44a28d3 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:23.745659 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02bd3c-7d97-4796-8685-ea2eb44a28d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:23.746350 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02bd3c-7d97-4796-8685-ea2eb44a28d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.755836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:23.760175 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:23.760830 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02bd3c-7d97-4796-8685-ea2eb44a28d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:23.763132 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02bd3c-7d97-4796-8685-ea2eb44a28d3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:23.764730 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ace00-f160-4791-be10-7f336ea50056 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-9b02bd3c-7d97-4796-8685-ea2eb44a28d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:23.783665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:23.784653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:23.785598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:23.785598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:23.785598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:23.785598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:23.785598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:23.785598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:23.785598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:23.785598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:23.788591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 366/728] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:23.795001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02bd3c-7d97-4796-8685-ea2eb44a28d3 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:23.802502 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf191f-3b9f-4695-b452-173c7b27681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:23.803198 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf191f-3b9f-4695-b452-173c7b27681e None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:23.803551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf191f-3b9f-4695-b452-173c7b27681e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:23.803928 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf191f-3b9f-4695-b452-173c7b27681e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.804750 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf191f-3b9f-4695-b452-173c7b27681e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:23.806195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf191f-3b9f-4695-b452-173c7b27681e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:23.908064 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02bd3c-7d97-4796-8685-ea2eb44a28d3 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:23.912384 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 363/729] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:12:23 2022] POST /identity/v3/endpoints => generated 329 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:12:23.960177 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842996d-336f-4f8c-9985-59051004270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:23.961238 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842996d-336f-4f8c-9985-59051004270e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:23.961741 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842996d-336f-4f8c-9985-59051004270e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:23.962226 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842996d-336f-4f8c-9985-59051004270e None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:23.963211 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842996d-336f-4f8c-9985-59051004270e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:23.963791 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842996d-336f-4f8c-9985-59051004270e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:23.965501 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842996d-336f-4f8c-9985-59051004270e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:23.980469 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 367/730] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:23.989357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf191f-3b9f-4695-b452-173c7b27681e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:24.097193 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf191f-3b9f-4695-b452-173c7b27681e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:24.140829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7334443-f6c1-4744-a700-4ef60e86de0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:24.141452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334443-f6c1-4744-a700-4ef60e86de0e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:24.144004 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334443-f6c1-4744-a700-4ef60e86de0e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:24.144004 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7334443-f6c1-4744-a700-4ef60e86de0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:24.144004 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7334443-f6c1-4744-a700-4ef60e86de0e None admin] RBAC: Adding query filter params (role.id=6d23401ca57e47398bf036ea320a7617, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=dcc3cee241bd45c49e37124cc4dd6e34) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:24.144004 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7334443-f6c1-4744-a700-4ef60e86de0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:24.144716 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7334443-f6c1-4744-a700-4ef60e86de0e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:24.151523 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 364/731] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:12:23 2022] GET /identity/v3/role_assignments?user.id=dcc3cee241bd45c49e37124cc4dd6e34&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=6d23401ca57e47398bf036ea320a7617 => generated 610 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:24.540203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5c283-cb28-41bf-a758-c2c1e2f5a558 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:24.540669 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5c283-cb28-41bf-a758-c2c1e2f5a558 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:24.541303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5c283-cb28-41bf-a758-c2c1e2f5a558 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:24.543004 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 368/732] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:24.548809 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04753cf-5bf9-44e8-a584-3819e80a4de9 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:24.549104 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04753cf-5bf9-44e8-a584-3819e80a4de9 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:24.549388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04753cf-5bf9-44e8-a584-3819e80a4de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:24.572612 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-f04753cf-5bf9-44e8-a584-3819e80a4de9 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:24.573819 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-f04753cf-5bf9-44e8-a584-3819e80a4de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:24.582919 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:24.615652 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6918-0523-4735-8313-07b1843725c6 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:24.615992 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6918-0523-4735-8313-07b1843725c6 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:24.616253 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f6918-0523-4735-8313-07b1843725c6 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:24.618028 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 369/733] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:24.623116 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf64ac-0a32-40aa-a3eb-844dcec62247 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:24.623404 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf64ac-0a32-40aa-a3eb-844dcec62247 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:24.623760 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf64ac-0a32-40aa-a3eb-844dcec62247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:24.643766 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-4dbf64ac-0a32-40aa-a3eb-844dcec62247 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:24.644993 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-4dbf64ac-0a32-40aa-a3eb-844dcec62247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:24.649921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 365/734] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:24 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:12:24.674598 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04753cf-5bf9-44e8-a584-3819e80a4de9 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:24.696900 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:24.726421 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 370/735] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:24 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:12:24.752198 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf64ac-0a32-40aa-a3eb-844dcec62247 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:24.782358 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04753cf-5bf9-44e8-a584-3819e80a4de9 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:24.818811 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51523a41-d70c-4631-b9a4-22cf3201f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:24.819733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51523a41-d70c-4631-b9a4-22cf3201f82a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:24.820018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51523a41-d70c-4631-b9a4-22cf3201f82a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:24.826858 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51523a41-d70c-4631-b9a4-22cf3201f82a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:24.826858 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51523a41-d70c-4631-b9a4-22cf3201f82a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:24.826858 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51523a41-d70c-4631-b9a4-22cf3201f82a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-51523a41-d70c-4631-b9a4-22cf3201f82a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:24.832280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:24.833210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:24.834131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 366/736] 10.222.0.100 () {56 vars in 1134 bytes} [Tue Jul 26 15:12:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:24.839499 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51523a41-d70c-4631-b9a4-22cf3201f82a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:24.850976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:24.864631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf64ac-0a32-40aa-a3eb-844dcec62247 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:24.902983 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8902-9df6-4eb4-b283-cfd8c20f9a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:24.904332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8902-9df6-4eb4-b283-cfd8c20f9a0c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:24.904769 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8902-9df6-4eb4-b283-cfd8c20f9a0c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:24.905291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8902-9df6-4eb4-b283-cfd8c20f9a0c None admin] PATH_INFO: `/v3/services/network` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:24.906196 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c8902-9df6-4eb4-b283-cfd8c20f9a0c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:24.907716 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c8902-9df6-4eb4-b283-cfd8c20f9a0c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-8f1c8902-9df6-4eb4-b283-cfd8c20f9a0c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:24.918529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:24.920249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 15:12:24.921255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:24.928704 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 371/737] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:24 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:12:24.929897 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8902-9df6-4eb4-b283-cfd8c20f9a0c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:24.950475 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51523a41-d70c-4631-b9a4-22cf3201f82a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:24.979424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:24.986419 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba2027-73f8-4110-982d-d891fdc30354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:24.987050 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba2027-73f8-4110-982d-d891fdc30354 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:24.987621 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba2027-73f8-4110-982d-d891fdc30354 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:24.987743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba2027-73f8-4110-982d-d891fdc30354 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:24.988367 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba2027-73f8-4110-982d-d891fdc30354 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:24.988723 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba2027-73f8-4110-982d-d891fdc30354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:24.990212 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba2027-73f8-4110-982d-d891fdc30354 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:24.999902 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 367/738] 10.222.0.100 () {56 vars in 1129 bytes} [Tue Jul 26 15:12:24 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:25.000973 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba2027-73f8-4110-982d-d891fdc30354 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:25.044273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8902-9df6-4eb4-b283-cfd8c20f9a0c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:25.077129 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:25.085680 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c815d-3287-4e02-a66c-45d0342ac2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:25.090508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c815d-3287-4e02-a66c-45d0342ac2fb None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:25.090508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c815d-3287-4e02-a66c-45d0342ac2fb None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:25.090508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c815d-3287-4e02-a66c-45d0342ac2fb None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:25.090508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c815d-3287-4e02-a66c-45d0342ac2fb None admin] RBAC: Adding query filter params (name=network) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:25.090508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c815d-3287-4e02-a66c-45d0342ac2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:25.090508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c815d-3287-4e02-a66c-45d0342ac2fb None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:25.099890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 372/739] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:24 2022] GET /identity/v3/services?name=network => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:25.100973 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c815d-3287-4e02-a66c-45d0342ac2fb None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:25.109304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba2027-73f8-4110-982d-d891fdc30354 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:25.147284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324d8c0-fb42-4641-ab00-bafe113e0709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:25.147900 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324d8c0-fb42-4641-ab00-bafe113e0709 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:25.148489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324d8c0-fb42-4641-ab00-bafe113e0709 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:25.148613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324d8c0-fb42-4641-ab00-bafe113e0709 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:25.149265 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324d8c0-fb42-4641-ab00-bafe113e0709 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:25.149575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324d8c0-fb42-4641-ab00-bafe113e0709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:25.151042 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324d8c0-fb42-4641-ab00-bafe113e0709 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:25.161271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 368/740] 10.222.0.100 () {56 vars in 1129 bytes} [Tue Jul 26 15:12:25 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:25.162129 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324d8c0-fb42-4641-ab00-bafe113e0709 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:25.214117 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c815d-3287-4e02-a66c-45d0342ac2fb None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:25.222051 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:25.253546 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eea2b6-6bc3-4923-b6ee-94b168c78615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:25.254177 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eea2b6-6bc3-4923-b6ee-94b168c78615 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:25.254464 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eea2b6-6bc3-4923-b6ee-94b168c78615 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:25.254743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eea2b6-6bc3-4923-b6ee-94b168c78615 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:25.255425 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eea2b6-6bc3-4923-b6ee-94b168c78615 None admin] RBAC: Adding query filter params (type=network) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:25.255730 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eea2b6-6bc3-4923-b6ee-94b168c78615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:25.257238 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eea2b6-6bc3-4923-b6ee-94b168c78615 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:25.262946 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 373/741] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:25 2022] GET /identity/v3/services?type=network => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:25.268460 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eea2b6-6bc3-4923-b6ee-94b168c78615 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:25.274152 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324d8c0-fb42-4641-ab00-bafe113e0709 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:25.312107 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f18e2a-dda3-4808-b5f5-7d96420ffb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:25.312786 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f18e2a-dda3-4808-b5f5-7d96420ffb3d None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:25.313147 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f18e2a-dda3-4808-b5f5-7d96420ffb3d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:25.313491 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f18e2a-dda3-4808-b5f5-7d96420ffb3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:25.314288 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f18e2a-dda3-4808-b5f5-7d96420ffb3d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:25.316373 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f18e2a-dda3-4808-b5f5-7d96420ffb3d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:25.321761 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:25.390076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eea2b6-6bc3-4923-b6ee-94b168c78615 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:25.436435 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 369/742] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:12:25 2022] POST /identity/v3/endpoints => generated 348 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:12:25.438546 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ae107-a781-45fa-adbb-f67999b6d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:25.440202 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae107-a781-45fa-adbb-f67999b6d5f9 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:25.440709 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae107-a781-45fa-adbb-f67999b6d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:25.441170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ae107-a781-45fa-adbb-f67999b6d5f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:25.442154 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ae107-a781-45fa-adbb-f67999b6d5f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:25.443834 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ae107-a781-45fa-adbb-f67999b6d5f9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:25.550278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 374/743] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:12:25 2022] POST /identity/v3/endpoints => generated 329 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:12:26.340004 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea142-3c5f-4d40-8a17-780ea9808c8a None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:26.340581 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea142-3c5f-4d40-8a17-780ea9808c8a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:26.340581 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ea142-3c5f-4d40-8a17-780ea9808c8a None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:26.342136 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 370/744] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:26.347509 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc1857-4f61-488d-a9d8-c0babe4417ff None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:26.347938 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc1857-4f61-488d-a9d8-c0babe4417ff None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:26.348132 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc1857-4f61-488d-a9d8-c0babe4417ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:26.367600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-d2fc1857-4f61-488d-a9d8-c0babe4417ff None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:26.368807 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-d2fc1857-4f61-488d-a9d8-c0babe4417ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:26.386707 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:26.448477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 375/745] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:26 2022] POST /identity/v3/auth/tokens => generated 1399 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:26.472259 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ea142-3c5f-4d40-8a17-780ea9808c8a None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:26.474627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeee79-6e60-4e00-863e-310318cf0d77 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:26.478393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeee79-6e60-4e00-863e-310318cf0d77 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:26.478393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeee79-6e60-4e00-863e-310318cf0d77 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:26.478393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 376/746] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:26 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:12:26.486293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32913c42-f7c4-464e-9e62-2cf4ba2f760e None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:26.486293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32913c42-f7c4-464e-9e62-2cf4ba2f760e None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:26.486293 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32913c42-f7c4-464e-9e62-2cf4ba2f760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:26.503116 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-32913c42-f7c4-464e-9e62-2cf4ba2f760e None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:26.504329 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-32913c42-f7c4-464e-9e62-2cf4ba2f760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:26.580859 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 377/747] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:26 2022] POST /identity/v3/auth/tokens => generated 1399 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:12:26.587325 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ea142-3c5f-4d40-8a17-780ea9808c8a None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:26.604420 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32913c42-f7c4-464e-9e62-2cf4ba2f760e None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:26.626977 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745551ff-adac-457f-99c1-2e88f09dcf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:26.627750 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745551ff-adac-457f-99c1-2e88f09dcf1e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:26.627861 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745551ff-adac-457f-99c1-2e88f09dcf1e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:26.628664 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745551ff-adac-457f-99c1-2e88f09dcf1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:26.690419 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:26.693910 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:26.705401 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745551ff-adac-457f-99c1-2e88f09dcf1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:26.707311 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745551ff-adac-457f-99c1-2e88f09dcf1e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:26.713210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32913c42-f7c4-464e-9e62-2cf4ba2f760e None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:26.753327 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b24063-9254-4177-94a4-e62fae915252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:26.754357 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b24063-9254-4177-94a4-e62fae915252 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:26.754513 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b24063-9254-4177-94a4-e62fae915252 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:26.754847 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b24063-9254-4177-94a4-e62fae915252 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:26.755304 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b24063-9254-4177-94a4-e62fae915252 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:26.756899 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b24063-9254-4177-94a4-e62fae915252 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-12b24063-9254-4177-94a4-e62fae915252 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:26.766190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:26.767161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:26.768620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 378/748] 10.222.0.100 () {56 vars in 1137 bytes} [Tue Jul 26 15:12:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:26.773713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b24063-9254-4177-94a4-e62fae915252 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:26.823746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 371/749] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:12:26 2022] GET /identity/v3/auth/tokens => generated 1399 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:12:26.825075 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745551ff-adac-457f-99c1-2e88f09dcf1e None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:26.883711 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b24063-9254-4177-94a4-e62fae915252 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:26.924211 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e404a6-f005-4867-9e66-25c78d94ba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:26.926129 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:26.926291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e404a6-f005-4867-9e66-25c78d94ba28 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:26.926291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e404a6-f005-4867-9e66-25c78d94ba28 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:26.926291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e404a6-f005-4867-9e66-25c78d94ba28 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:26.926943 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e404a6-f005-4867-9e66-25c78d94ba28 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:26.927407 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e404a6-f005-4867-9e66-25c78d94ba28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:26.928824 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e404a6-f005-4867-9e66-25c78d94ba28 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:26.934580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 379/750] 10.222.0.100 () {56 vars in 1131 bytes} [Tue Jul 26 15:12:26 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:26.934842 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745551ff-adac-457f-99c1-2e88f09dcf1e None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:26.940097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e404a6-f005-4867-9e66-25c78d94ba28 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:26.949774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:26.975937 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f06f-3d1c-4ae2-9a59-3da0f55bc03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:26.976616 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f06f-3d1c-4ae2-9a59-3da0f55bc03a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:26.976898 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f06f-3d1c-4ae2-9a59-3da0f55bc03a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:26.977168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f06f-3d1c-4ae2-9a59-3da0f55bc03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:26.988848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09f06f-3d1c-4ae2-9a59-3da0f55bc03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:26.990318 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09f06f-3d1c-4ae2-9a59-3da0f55bc03a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-9b09f06f-3d1c-4ae2-9a59-3da0f55bc03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:12:27.006375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:27.007333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:27.008264 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:12:27.008264 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:12:27.008264 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:12:27.008264 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:27.012447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 372/751] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:27.013207 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f06f-3d1c-4ae2-9a59-3da0f55bc03a None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:27.057318 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e404a6-f005-4867-9e66-25c78d94ba28 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:27.094396 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c156d84-b938-4c83-a668-5c64a7ae1e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:27.095016 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c156d84-b938-4c83-a668-5c64a7ae1e98 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:27.095300 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c156d84-b938-4c83-a668-5c64a7ae1e98 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:27.095636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c156d84-b938-4c83-a668-5c64a7ae1e98 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:27.096965 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c156d84-b938-4c83-a668-5c64a7ae1e98 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:27.097277 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c156d84-b938-4c83-a668-5c64a7ae1e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:27.098660 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c156d84-b938-4c83-a668-5c64a7ae1e98 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:27.103885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 380/752] 10.222.0.100 () {56 vars in 1131 bytes} [Tue Jul 26 15:12:26 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:27.123030 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f06f-3d1c-4ae2-9a59-3da0f55bc03a None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:27.161835 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7287b-25ce-4ad2-88af-c5cc726d510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:27.162395 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7287b-25ce-4ad2-88af-c5cc726d510d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:27.162680 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7287b-25ce-4ad2-88af-c5cc726d510d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:27.162959 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7287b-25ce-4ad2-88af-c5cc726d510d None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:27.163675 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7287b-25ce-4ad2-88af-c5cc726d510d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:27.163987 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7287b-25ce-4ad2-88af-c5cc726d510d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:27.165487 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7287b-25ce-4ad2-88af-c5cc726d510d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:27.188460 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 373/753] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:27.721188 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216d3a-1e64-471f-93e8-f3f8208e64bf None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:27.721749 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216d3a-1e64-471f-93e8-f3f8208e64bf None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:27.721749 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06216d3a-1e64-471f-93e8-f3f8208e64bf None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:27.723067 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 381/754] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:27.728311 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0c794-0aca-41a1-956e-2dba84051e9c None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:27.728729 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0c794-0aca-41a1-956e-2dba84051e9c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:27.728985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0c794-0aca-41a1-956e-2dba84051e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:27.735792 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:27.755053 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-fba0c794-0aca-41a1-956e-2dba84051e9c None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:27.755053 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-fba0c794-0aca-41a1-956e-2dba84051e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:27.816442 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 374/755] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:27 2022] POST /identity/v3/auth/tokens => generated 1399 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:27.839531 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06216d3a-1e64-471f-93e8-f3f8208e64bf None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:27.910460 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:27.942248 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06216d3a-1e64-471f-93e8-f3f8208e64bf None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:27.976590 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557dce2-f76f-4437-b333-797d7a9525ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:27.977216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557dce2-f76f-4437-b333-797d7a9525ec None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:27.977498 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557dce2-f76f-4437-b333-797d7a9525ec None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:27.977774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557dce2-f76f-4437-b333-797d7a9525ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:27.978379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557dce2-f76f-4437-b333-797d7a9525ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:27.979732 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557dce2-f76f-4437-b333-797d7a9525ec None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-b557dce2-f76f-4437-b333-797d7a9525ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:27.988889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:27.994908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:27.995805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 382/756] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:12:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:27.996671 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0c794-0aca-41a1-956e-2dba84051e9c None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:28.092384 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0c794-0aca-41a1-956e-2dba84051e9c None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:28.122629 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:28.127752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3004c69-ef5d-418b-9531-938d223c8d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:28.128401 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3004c69-ef5d-418b-9531-938d223c8d8e None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:28.128724 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3004c69-ef5d-418b-9531-938d223c8d8e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:28.129003 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3004c69-ef5d-418b-9531-938d223c8d8e None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:28.129679 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3004c69-ef5d-418b-9531-938d223c8d8e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:28.129983 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3004c69-ef5d-418b-9531-938d223c8d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:28.131370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3004c69-ef5d-418b-9531-938d223c8d8e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:28.135949 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 375/757] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:12:27 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:28.141785 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557dce2-f76f-4437-b333-797d7a9525ec None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:28.243072 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557dce2-f76f-4437-b333-797d7a9525ec None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:28.280806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd32f21-58f2-4b4b-a7a1-8556cd377dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:28.281424 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd32f21-58f2-4b4b-a7a1-8556cd377dde None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:28.281703 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd32f21-58f2-4b4b-a7a1-8556cd377dde None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:28.281976 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd32f21-58f2-4b4b-a7a1-8556cd377dde None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:28.282725 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd32f21-58f2-4b4b-a7a1-8556cd377dde None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:28.282948 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd32f21-58f2-4b4b-a7a1-8556cd377dde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:28.284315 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd32f21-58f2-4b4b-a7a1-8556cd377dde None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:28.285602 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:28.289321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 383/758] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:12:28 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:29.369575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3dcd1-3414-4dfe-9faf-b699cd8f5235 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:29.370290 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3dcd1-3414-4dfe-9faf-b699cd8f5235 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:29.370290 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3dcd1-3414-4dfe-9faf-b699cd8f5235 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:29.371651 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 376/759] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:29.376703 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb20e-617b-4239-8648-1265625089ce None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:29.377687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb20e-617b-4239-8648-1265625089ce None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:29.377805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbb20e-617b-4239-8648-1265625089ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:29.395913 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-7fbbb20e-617b-4239-8648-1265625089ce None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:29.397105 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-7fbbb20e-617b-4239-8648-1265625089ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:29.469385 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 384/760] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:29 2022] POST /identity/v3/auth/tokens => generated 1399 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:29.494519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3dcd1-3414-4dfe-9faf-b699cd8f5235 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:29.603243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3dcd1-3414-4dfe-9faf-b699cd8f5235 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:29.636697 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e70b91-2047-400c-bf2d-9046b36fd7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:29.637243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e70b91-2047-400c-bf2d-9046b36fd7cf None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:29.637528 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e70b91-2047-400c-bf2d-9046b36fd7cf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:29.637806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e70b91-2047-400c-bf2d-9046b36fd7cf None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:29.638643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e70b91-2047-400c-bf2d-9046b36fd7cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:29.640027 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e70b91-2047-400c-bf2d-9046b36fd7cf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:29.744394 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 377/761] 10.222.0.100 () {60 vars in 1146 bytes} [Tue Jul 26 15:12:29 2022] POST /identity/v3/services => generated 270 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:12:30.551157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387a91-7b59-4ce3-9f52-6207b884b1fb None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:30.551711 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387a91-7b59-4ce3-9f52-6207b884b1fb None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:30.551711 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a387a91-7b59-4ce3-9f52-6207b884b1fb None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:30.553082 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 385/762] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:30.558225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51669516-426e-4341-944f-53ef7b6f0379 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:30.558617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51669516-426e-4341-944f-53ef7b6f0379 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:30.558781 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51669516-426e-4341-944f-53ef7b6f0379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:30.576413 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-51669516-426e-4341-944f-53ef7b6f0379 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:30.577693 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-51669516-426e-4341-944f-53ef7b6f0379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:30.629474 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:30.657774 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 378/763] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:30 2022] POST /identity/v3/auth/tokens => generated 1509 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:30.682000 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a387a91-7b59-4ce3-9f52-6207b884b1fb None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:30.783003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a387a91-7b59-4ce3-9f52-6207b884b1fb None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:30.817127 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:30.825321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffafcb-f43d-4e72-8a51-99e3e8b4ca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:30.825948 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffafcb-f43d-4e72-8a51-99e3e8b4ca69 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:30.826235 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffafcb-f43d-4e72-8a51-99e3e8b4ca69 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:30.826517 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffafcb-f43d-4e72-8a51-99e3e8b4ca69 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:30.827250 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffafcb-f43d-4e72-8a51-99e3e8b4ca69 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:30.828735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffafcb-f43d-4e72-8a51-99e3e8b4ca69 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:30.911190 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 386/764] 10.222.0.100 () {60 vars in 1146 bytes} [Tue Jul 26 15:12:30 2022] POST /identity/v3/services => generated 252 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:12:32.020969 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4effe-b886-4ef4-99f1-1958844c9588 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:32.021496 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4effe-b886-4ef4-99f1-1958844c9588 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:32.021496 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4effe-b886-4ef4-99f1-1958844c9588 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:32.022833 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 379/765] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:32.028325 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270881a9-ebf3-489b-b7eb-14928b3cc4bb None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:32.028767 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270881a9-ebf3-489b-b7eb-14928b3cc4bb None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:32.029109 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270881a9-ebf3-489b-b7eb-14928b3cc4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:32.049457 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-270881a9-ebf3-489b-b7eb-14928b3cc4bb None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:32.050711 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-270881a9-ebf3-489b-b7eb-14928b3cc4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:32.125066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 387/766] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:32 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 15:12:32.149537 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4effe-b886-4ef4-99f1-1958844c9588 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:32.248072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4effe-b886-4ef4-99f1-1958844c9588 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:32.281242 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28cabb-9dd3-4a32-8a26-e95a5f477dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:32.281799 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28cabb-9dd3-4a32-8a26-e95a5f477dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:32.282082 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28cabb-9dd3-4a32-8a26-e95a5f477dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:32.282357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28cabb-9dd3-4a32-8a26-e95a5f477dd2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:32.282982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28cabb-9dd3-4a32-8a26-e95a5f477dd2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:32.284401 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28cabb-9dd3-4a32-8a26-e95a5f477dd2 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-5a28cabb-9dd3-4a32-8a26-e95a5f477dd2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:32.293331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:32.294271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:32.295307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 380/767] 10.222.0.100 () {56 vars in 1137 bytes} [Tue Jul 26 15:12:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:32.301088 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270881a9-ebf3-489b-b7eb-14928b3cc4bb None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:32.398178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270881a9-ebf3-489b-b7eb-14928b3cc4bb None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:32.412308 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:32.438089 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b635a-e6de-4926-9e4d-05e97c7e65a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:32.438708 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b635a-e6de-4926-9e4d-05e97c7e65a0 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:32.438990 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b635a-e6de-4926-9e4d-05e97c7e65a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:32.439267 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b635a-e6de-4926-9e4d-05e97c7e65a0 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:32.439962 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b635a-e6de-4926-9e4d-05e97c7e65a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:32.440636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b635a-e6de-4926-9e4d-05e97c7e65a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:32.445613 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b635a-e6de-4926-9e4d-05e97c7e65a0 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:32.455899 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 388/768] 10.222.0.100 () {56 vars in 1131 bytes} [Tue Jul 26 15:12:32 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:32.461744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28cabb-9dd3-4a32-8a26-e95a5f477dd2 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:32.516423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:32.569161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28cabb-9dd3-4a32-8a26-e95a5f477dd2 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:32.601882 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e56b2-109c-444f-806a-965b5d15eb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:32.602489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e56b2-109c-444f-806a-965b5d15eb25 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:32.602881 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e56b2-109c-444f-806a-965b5d15eb25 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:32.603159 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e56b2-109c-444f-806a-965b5d15eb25 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:32.603826 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e56b2-109c-444f-806a-965b5d15eb25 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:32.604145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e56b2-109c-444f-806a-965b5d15eb25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:32.605515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e56b2-109c-444f-806a-965b5d15eb25 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:32.610325 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 381/769] 10.222.0.100 () {56 vars in 1131 bytes} [Tue Jul 26 15:12:32 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:32.616789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b635a-e6de-4926-9e4d-05e97c7e65a0 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:32.716109 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b635a-e6de-4926-9e4d-05e97c7e65a0 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:32.750890 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c699f-8141-43e5-9815-9e79adf5c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:32.751495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c699f-8141-43e5-9815-9e79adf5c99e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:32.751867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c699f-8141-43e5-9815-9e79adf5c99e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:32.752136 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c699f-8141-43e5-9815-9e79adf5c99e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:32.752893 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c699f-8141-43e5-9815-9e79adf5c99e None admin] RBAC: Adding query filter params (interface=public, service_id=9a8f3497a4224f3a81a9d23342e0a89f, region_id=RegionOne) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:32.753198 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c699f-8141-43e5-9815-9e79adf5c99e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:32.754662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c699f-8141-43e5-9815-9e79adf5c99e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:32.759805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 389/770] 10.222.0.100 () {56 vars in 1256 bytes} [Tue Jul 26 15:12:32 2022] GET /identity/v3/endpoints?service_id=9a8f3497a4224f3a81a9d23342e0a89f&interface=public®ion_id=RegionOne => generated 195 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:32.765491 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e56b2-109c-444f-806a-965b5d15eb25 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:32.871581 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e56b2-109c-444f-806a-965b5d15eb25 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:32.881875 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:32.905399 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51194c93-6650-4198-b609-a1abeb5651ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:32.906008 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51194c93-6650-4198-b609-a1abeb5651ec None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:32.906290 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51194c93-6650-4198-b609-a1abeb5651ec None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:32.906567 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51194c93-6650-4198-b609-a1abeb5651ec None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:32.907211 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51194c93-6650-4198-b609-a1abeb5651ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:32.909224 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51194c93-6650-4198-b609-a1abeb5651ec None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:32.915065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 382/771] 10.222.0.100 () {56 vars in 1092 bytes} [Tue Jul 26 15:12:32 2022] GET /identity/v3/services => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:12:33.154659 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75576ce3-5fa2-4606-aad6-0dc3b3f42c98 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:33.155181 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75576ce3-5fa2-4606-aad6-0dc3b3f42c98 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:33.155181 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75576ce3-5fa2-4606-aad6-0dc3b3f42c98 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:33.156645 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 390/772] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:33.162832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58917a59-f1ef-41c5-9248-417e038e1bce None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:33.163303 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58917a59-f1ef-41c5-9248-417e038e1bce None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:33.163382 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58917a59-f1ef-41c5-9248-417e038e1bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:33.181500 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-58917a59-f1ef-41c5-9248-417e038e1bce None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:33.182676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-58917a59-f1ef-41c5-9248-417e038e1bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:33.248184 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 383/773] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:33 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:33.272702 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75576ce3-5fa2-4606-aad6-0dc3b3f42c98 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:33.318726 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:33.374779 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75576ce3-5fa2-4606-aad6-0dc3b3f42c98 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:33.409784 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4d04e-f8ec-490b-83e9-0efa5f9cd62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:33.410343 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4d04e-f8ec-490b-83e9-0efa5f9cd62e None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:33.410622 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4d04e-f8ec-490b-83e9-0efa5f9cd62e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:33.410895 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4d04e-f8ec-490b-83e9-0efa5f9cd62e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:33.411513 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4d04e-f8ec-490b-83e9-0efa5f9cd62e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:33.413017 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4d04e-f8ec-490b-83e9-0efa5f9cd62e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-92b4d04e-f8ec-490b-83e9-0efa5f9cd62e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:33.422130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:33.423171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:33.424611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 391/774] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:12:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:33.429813 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58917a59-f1ef-41c5-9248-417e038e1bce None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:33.533896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58917a59-f1ef-41c5-9248-417e038e1bce None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:33.536140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:33.567227 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e00e37-80f2-4a6c-ac43-4963675b4690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:33.567873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e00e37-80f2-4a6c-ac43-4963675b4690 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:33.568182 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e00e37-80f2-4a6c-ac43-4963675b4690 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:33.568460 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e00e37-80f2-4a6c-ac43-4963675b4690 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:33.569187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e00e37-80f2-4a6c-ac43-4963675b4690 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:33.569499 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e00e37-80f2-4a6c-ac43-4963675b4690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:33.570923 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e00e37-80f2-4a6c-ac43-4963675b4690 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:33.575604 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 384/775] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:12:33 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:33.581908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4d04e-f8ec-490b-83e9-0efa5f9cd62e None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:33.682297 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4d04e-f8ec-490b-83e9-0efa5f9cd62e None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:33.689271 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:33.716980 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b1d04-12b2-472f-b1e1-6ea4d9772499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:33.717597 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1d04-12b2-472f-b1e1-6ea4d9772499 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:33.717876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1d04-12b2-472f-b1e1-6ea4d9772499 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:33.718148 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1d04-12b2-472f-b1e1-6ea4d9772499 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:33.718812 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b1d04-12b2-472f-b1e1-6ea4d9772499 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:33.719112 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b1d04-12b2-472f-b1e1-6ea4d9772499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:33.720503 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b1d04-12b2-472f-b1e1-6ea4d9772499 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:33.725873 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 392/776] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:12:33 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:33.731739 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e00e37-80f2-4a6c-ac43-4963675b4690 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:33.826955 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e00e37-80f2-4a6c-ac43-4963675b4690 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:33.860360 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d36c6-4760-48df-bcb9-9b8286a4b27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:33.860976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d36c6-4760-48df-bcb9-9b8286a4b27d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:33.861265 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d36c6-4760-48df-bcb9-9b8286a4b27d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:33.861536 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d36c6-4760-48df-bcb9-9b8286a4b27d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:33.864647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d36c6-4760-48df-bcb9-9b8286a4b27d None admin] RBAC: Adding query filter params (interface=public, service_id=14e06c5043654236bbd345ec648f7a97, region_id=RegionOne) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:33.864647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d36c6-4760-48df-bcb9-9b8286a4b27d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:33.864647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d36c6-4760-48df-bcb9-9b8286a4b27d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:33.868768 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 385/777] 10.222.0.100 () {56 vars in 1256 bytes} [Tue Jul 26 15:12:33 2022] GET /identity/v3/endpoints?service_id=14e06c5043654236bbd345ec648f7a97&interface=public®ion_id=RegionOne => generated 195 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:33.874402 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b1d04-12b2-472f-b1e1-6ea4d9772499 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:33.972933 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b1d04-12b2-472f-b1e1-6ea4d9772499 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:34.006734 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350004e-8604-4cab-8c10-eda7fafca180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:34.007367 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350004e-8604-4cab-8c10-eda7fafca180 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:34.007657 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350004e-8604-4cab-8c10-eda7fafca180 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:34.007942 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350004e-8604-4cab-8c10-eda7fafca180 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:34.008653 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350004e-8604-4cab-8c10-eda7fafca180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:34.010036 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350004e-8604-4cab-8c10-eda7fafca180 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:34.016423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 393/778] 10.222.0.100 () {56 vars in 1092 bytes} [Tue Jul 26 15:12:33 2022] GET /identity/v3/services => generated 1505 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:12:35.192478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362b473-9dd3-4ef3-ab47-b256afddeda3 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:35.193015 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362b473-9dd3-4ef3-ab47-b256afddeda3 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:35.193015 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362b473-9dd3-4ef3-ab47-b256afddeda3 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:35.194326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 386/779] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:35.199551 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265d9a0-a5f7-4528-b422-dd36eff7e237 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:35.199944 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265d9a0-a5f7-4528-b422-dd36eff7e237 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:35.200132 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265d9a0-a5f7-4528-b422-dd36eff7e237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:35.224606 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-1265d9a0-a5f7-4528-b422-dd36eff7e237 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:35.225815 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-1265d9a0-a5f7-4528-b422-dd36eff7e237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:35.259673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:35.300987 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 394/780] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:35 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:35.324057 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362b473-9dd3-4ef3-ab47-b256afddeda3 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:35.356016 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:35.424589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362b473-9dd3-4ef3-ab47-b256afddeda3 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:35.456312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb055650-ddd6-4df3-a63c-c2017149ad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:35.456921 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055650-ddd6-4df3-a63c-c2017149ad62 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:35.457197 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055650-ddd6-4df3-a63c-c2017149ad62 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:35.457467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055650-ddd6-4df3-a63c-c2017149ad62 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:35.458080 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb055650-ddd6-4df3-a63c-c2017149ad62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:35.459433 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb055650-ddd6-4df3-a63c-c2017149ad62 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-bb055650-ddd6-4df3-a63c-c2017149ad62 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:35.467980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:35.468962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:35.469829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 387/781] 10.222.0.100 () {56 vars in 1137 bytes} [Tue Jul 26 15:12:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:35.475803 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265d9a0-a5f7-4528-b422-dd36eff7e237 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:35.578764 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265d9a0-a5f7-4528-b422-dd36eff7e237 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:35.630845 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401beb7-cdde-4ad9-a110-21fe56f5bdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:35.631554 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401beb7-cdde-4ad9-a110-21fe56f5bdc3 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:35.631834 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401beb7-cdde-4ad9-a110-21fe56f5bdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:35.632129 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401beb7-cdde-4ad9-a110-21fe56f5bdc3 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:35.633564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401beb7-cdde-4ad9-a110-21fe56f5bdc3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:35.633911 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401beb7-cdde-4ad9-a110-21fe56f5bdc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:35.637362 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401beb7-cdde-4ad9-a110-21fe56f5bdc3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:35.645634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 395/782] 10.222.0.100 () {56 vars in 1131 bytes} [Tue Jul 26 15:12:35 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:35.651092 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb055650-ddd6-4df3-a63c-c2017149ad62 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:35.745829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:35.752447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb055650-ddd6-4df3-a63c-c2017149ad62 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:35.786082 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cc89d-80f8-42c8-b531-135eebb43ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:35.786721 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cc89d-80f8-42c8-b531-135eebb43ac7 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:35.787003 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cc89d-80f8-42c8-b531-135eebb43ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:35.787278 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cc89d-80f8-42c8-b531-135eebb43ac7 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:35.787952 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cc89d-80f8-42c8-b531-135eebb43ac7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:35.788297 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cc89d-80f8-42c8-b531-135eebb43ac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:35.789664 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cc89d-80f8-42c8-b531-135eebb43ac7 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:35.794720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 388/783] 10.222.0.100 () {56 vars in 1131 bytes} [Tue Jul 26 15:12:35 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:35.801058 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401beb7-cdde-4ad9-a110-21fe56f5bdc3 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:35.829618 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:35.901058 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401beb7-cdde-4ad9-a110-21fe56f5bdc3 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:35.935438 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66832b6f-c95d-4bdb-89da-36b597d56d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:35.936066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66832b6f-c95d-4bdb-89da-36b597d56d93 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:35.936368 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66832b6f-c95d-4bdb-89da-36b597d56d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:35.936636 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66832b6f-c95d-4bdb-89da-36b597d56d93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:35.937346 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66832b6f-c95d-4bdb-89da-36b597d56d93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:35.938699 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66832b6f-c95d-4bdb-89da-36b597d56d93 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:36.030539 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 396/784] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:12:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:12:36.309568 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b141-f34a-40c7-b0df-5e4a800e8dec None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:36.310275 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b141-f34a-40c7-b0df-5e4a800e8dec None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:36.310275 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b141-f34a-40c7-b0df-5e4a800e8dec None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:36.311359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 389/785] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:36.316536 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c09e71-b364-475b-abb1-f87474ff1a4f None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:36.316925 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c09e71-b364-475b-abb1-f87474ff1a4f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:36.317211 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c09e71-b364-475b-abb1-f87474ff1a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:36.335106 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-f3c09e71-b364-475b-abb1-f87474ff1a4f None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:36.336320 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f3c09e71-b364-475b-abb1-f87474ff1a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:36.407757 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 397/786] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:36 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:36.432480 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7b141-f34a-40c7-b0df-5e4a800e8dec None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:36.536567 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7b141-f34a-40c7-b0df-5e4a800e8dec None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:36.571279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192e2f-a6d7-4591-847f-03c2fb501fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:36.571831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192e2f-a6d7-4591-847f-03c2fb501fbd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:36.572139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192e2f-a6d7-4591-847f-03c2fb501fbd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:36.572413 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d192e2f-a6d7-4591-847f-03c2fb501fbd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:36.573033 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d192e2f-a6d7-4591-847f-03c2fb501fbd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:36.574397 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d192e2f-a6d7-4591-847f-03c2fb501fbd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-2d192e2f-a6d7-4591-847f-03c2fb501fbd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:36.583630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:36.584699 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:36.585930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 390/787] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:12:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:36.590758 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c09e71-b364-475b-abb1-f87474ff1a4f None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:36.602874 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:36.690160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c09e71-b364-475b-abb1-f87474ff1a4f None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:36.725987 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146fe1-a8aa-4077-bd10-ef5c6503e446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:36.726605 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146fe1-a8aa-4077-bd10-ef5c6503e446 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:36.726885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146fe1-a8aa-4077-bd10-ef5c6503e446 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:36.727159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22146fe1-a8aa-4077-bd10-ef5c6503e446 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:36.727830 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22146fe1-a8aa-4077-bd10-ef5c6503e446 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:36.728163 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22146fe1-a8aa-4077-bd10-ef5c6503e446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:36.729526 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22146fe1-a8aa-4077-bd10-ef5c6503e446 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:36.734356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 398/788] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:12:36 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:36.740539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192e2f-a6d7-4591-847f-03c2fb501fbd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:36.767208 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:36.841471 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d192e2f-a6d7-4591-847f-03c2fb501fbd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:36.876609 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647677d6-6cf2-40c6-8a7a-91ea1bf04f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:36.877866 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647677d6-6cf2-40c6-8a7a-91ea1bf04f92 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:36.878192 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647677d6-6cf2-40c6-8a7a-91ea1bf04f92 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:36.878464 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647677d6-6cf2-40c6-8a7a-91ea1bf04f92 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:36.879134 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647677d6-6cf2-40c6-8a7a-91ea1bf04f92 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:36.879434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647677d6-6cf2-40c6-8a7a-91ea1bf04f92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:36.880835 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647677d6-6cf2-40c6-8a7a-91ea1bf04f92 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:36.885616 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 391/789] 10.222.0.100 () {56 vars in 1119 bytes} [Tue Jul 26 15:12:36 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:36.891330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146fe1-a8aa-4077-bd10-ef5c6503e446 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:36.966298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:36.991854 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22146fe1-a8aa-4077-bd10-ef5c6503e446 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:37.025519 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1622dd5-40e8-4770-8591-9d6abf3b88ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:37.026125 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1622dd5-40e8-4770-8591-9d6abf3b88ea None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:37.026403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1622dd5-40e8-4770-8591-9d6abf3b88ea None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:37.026676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1622dd5-40e8-4770-8591-9d6abf3b88ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:37.027376 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1622dd5-40e8-4770-8591-9d6abf3b88ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:37.028805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1622dd5-40e8-4770-8591-9d6abf3b88ea None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:37.191310 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 399/790] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:12:36 2022] POST /identity/v3/endpoints => generated 348 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:12:38.280920 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b810b-156f-4536-b3ea-85ba47519431 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:38.281447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b810b-156f-4536-b3ea-85ba47519431 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:38.281447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b810b-156f-4536-b3ea-85ba47519431 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:38.282786 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 392/791] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:38.288046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246d5b9-dd98-40dd-b8d1-4f93319e5219 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:38.288485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246d5b9-dd98-40dd-b8d1-4f93319e5219 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:38.288633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246d5b9-dd98-40dd-b8d1-4f93319e5219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:38.307467 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-c246d5b9-dd98-40dd-b8d1-4f93319e5219 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:38.308705 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-c246d5b9-dd98-40dd-b8d1-4f93319e5219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:38.383676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 400/792] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:38 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:38.406558 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b810b-156f-4536-b3ea-85ba47519431 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:38.494131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:38.506901 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b810b-156f-4536-b3ea-85ba47519431 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:38.543406 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d9819-1a66-4f88-a255-663b472e9ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:38.543943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d9819-1a66-4f88-a255-663b472e9ae8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:38.544253 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d9819-1a66-4f88-a255-663b472e9ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:38.544532 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d9819-1a66-4f88-a255-663b472e9ae8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:38.545150 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d9819-1a66-4f88-a255-663b472e9ae8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:38.546515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d9819-1a66-4f88-a255-663b472e9ae8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-b15d9819-1a66-4f88-a255-663b472e9ae8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:38.555748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:38.556771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:38.557625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 393/793] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:38.562934 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246d5b9-dd98-40dd-b8d1-4f93319e5219 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:38.627034 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:38.670516 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246d5b9-dd98-40dd-b8d1-4f93319e5219 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:38.704314 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7eac2-59d0-49fe-ae91-ac6bc3cb2361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:38.704910 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7eac2-59d0-49fe-ae91-ac6bc3cb2361 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:38.705194 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7eac2-59d0-49fe-ae91-ac6bc3cb2361 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:38.705470 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7eac2-59d0-49fe-ae91-ac6bc3cb2361 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:38.706140 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7eac2-59d0-49fe-ae91-ac6bc3cb2361 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:38.706443 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7eac2-59d0-49fe-ae91-ac6bc3cb2361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:38.707821 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7eac2-59d0-49fe-ae91-ac6bc3cb2361 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:38.712465 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 401/794] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:38 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:38.717989 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d9819-1a66-4f88-a255-663b472e9ae8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:38.826970 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d9819-1a66-4f88-a255-663b472e9ae8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:38.851852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f8fb6-9cc6-4e6c-92ba-88189f8ea9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:38.852488 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8fb6-9cc6-4e6c-92ba-88189f8ea9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:38.852822 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8fb6-9cc6-4e6c-92ba-88189f8ea9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:38.860200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f8fb6-9cc6-4e6c-92ba-88189f8ea9d3 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:38.860200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f8fb6-9cc6-4e6c-92ba-88189f8ea9d3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:38.860200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f8fb6-9cc6-4e6c-92ba-88189f8ea9d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:38.860200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f8fb6-9cc6-4e6c-92ba-88189f8ea9d3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:38.860200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 394/795] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:38 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:12:39.448212 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38e018-1af2-4338-b43c-d1d2fd579daa None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:39.448744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38e018-1af2-4338-b43c-d1d2fd579daa None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:39.448744 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38e018-1af2-4338-b43c-d1d2fd579daa None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:39.450076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 402/796] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:39.456528 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f835c6-95b6-42e4-a208-67e4458a6d7a None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:39.456950 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f835c6-95b6-42e4-a208-67e4458a6d7a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:39.457086 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f835c6-95b6-42e4-a208-67e4458a6d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:39.475925 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-f7f835c6-95b6-42e4-a208-67e4458a6d7a None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:39.477161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-f7f835c6-95b6-42e4-a208-67e4458a6d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:39.490632 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:39.547141 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 395/797] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:39 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:39.571915 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38e018-1af2-4338-b43c-d1d2fd579daa None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:39.671571 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38e018-1af2-4338-b43c-d1d2fd579daa None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:39.692808 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:39.706166 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:39.706769 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:39.707048 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:39.707320 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:39.707989 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:39.709438 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:39.712177 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: WARNING keystone.server.flask.common [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 15:12:39.771763 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.sql.core [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 15:12:39.771763 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 15:12:39.771763 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [parameters: {'id': '7c06e4321f9b4d0aa8942949ff5edb29', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 15:12:39.771763 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87488) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c06e4321f9b4d0aa8942949ff5edb29.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c06e4321f9b4d0aa8942949ff5edb29. Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application conn.query(q) Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 15:12:39.788319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application result.read() Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 15:12:39.789195 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application next(self.gen) Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application yield resource Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application next(self.gen) Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise self.value Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application session.commit() Jul 26 15:12:39.790332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self.session.flush() Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application compat.raise_( Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 15:12:39.791828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 15:12:39.797648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application conn.query(q) Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application result.read() Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 15:12:39.799284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [parameters: {'id': '7c06e4321f9b4d0aa8942949ff5edb29', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:39.800687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:39.801731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:39.802839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:39.802839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 15:12:39.802839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 15:12:39.802839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:39.802839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:39.802839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 15:12:39.802839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 15:12:39.802839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7c06e4321f9b4d0aa8942949ff5edb29. Jul 26 15:12:39.802839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:39.802839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 403/798] 10.222.0.100 () {60 vars in 1145 bytes} [Tue Jul 26 15:12:39 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:39.803620 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f835c6-95b6-42e4-a208-67e4458a6d7a None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:39.894605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f835c6-95b6-42e4-a208-67e4458a6d7a None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:39.928210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d3ed8-b5a7-460c-b36c-460628b05830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:39.928842 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3ed8-b5a7-460c-b36c-460628b05830 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:39.929124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3ed8-b5a7-460c-b36c-460628b05830 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:39.929398 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d3ed8-b5a7-460c-b36c-460628b05830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:39.935836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d3ed8-b5a7-460c-b36c-460628b05830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:39.937339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d3ed8-b5a7-460c-b36c-460628b05830 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-171d3ed8-b5a7-460c-b36c-460628b05830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:12:39.948557 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:39.949646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:39.950624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:12:39.950624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:12:39.950624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:12:39.950624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:12:39.950624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:12:39.950624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:12:39.950624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:12:39.950624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:39.950624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 396/799] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:39.956938 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:40.067456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c797798-d77c-4b3f-affe-53947e33c9c3 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:40.101078 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f55301-645c-4be9-9d80-a646063ca9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:40.101698 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f55301-645c-4be9-9d80-a646063ca9e2 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:40.101981 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f55301-645c-4be9-9d80-a646063ca9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:40.102257 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f55301-645c-4be9-9d80-a646063ca9e2 None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:40.102973 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f55301-645c-4be9-9d80-a646063ca9e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:40.103282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f55301-645c-4be9-9d80-a646063ca9e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:40.104954 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f55301-645c-4be9-9d80-a646063ca9e2 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:40.125135 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 404/800] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:39 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:41.067913 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a61f-ed03-42df-b9c2-6ba5f4086f12 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:41.068488 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a61f-ed03-42df-b9c2-6ba5f4086f12 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:41.068488 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a61f-ed03-42df-b9c2-6ba5f4086f12 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:41.069798 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 397/801] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:41.074896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f169-8242-47c7-8c24-17e23aaf5ef3 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:41.075332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f169-8242-47c7-8c24-17e23aaf5ef3 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:41.075459 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f169-8242-47c7-8c24-17e23aaf5ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:41.094689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-4f55f169-8242-47c7-8c24-17e23aaf5ef3 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:41.096850 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-4f55f169-8242-47c7-8c24-17e23aaf5ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:41.124490 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:41.163097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 405/802] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:41 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:41.186712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7a61f-ed03-42df-b9c2-6ba5f4086f12 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:41.195864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:41.289625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7a61f-ed03-42df-b9c2-6ba5f4086f12 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:41.324021 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e26a09-1689-4109-b7d7-45179aeb4c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:41.324573 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26a09-1689-4109-b7d7-45179aeb4c2e None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:41.324849 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26a09-1689-4109-b7d7-45179aeb4c2e None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:41.325124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26a09-1689-4109-b7d7-45179aeb4c2e None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:41.326244 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e26a09-1689-4109-b7d7-45179aeb4c2e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:41.327510 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e26a09-1689-4109-b7d7-45179aeb4c2e None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:41.458629 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 398/803] 10.222.0.100 () {60 vars in 1146 bytes} [Tue Jul 26 15:12:41 2022] POST /identity/v3/services => generated 243 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:12:42.399987 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395b74-ff55-4911-bf6f-dbc622a822a3 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:42.400563 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395b74-ff55-4911-bf6f-dbc622a822a3 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:42.400563 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5395b74-ff55-4911-bf6f-dbc622a822a3 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:42.401936 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 406/804] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:42.407540 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49877193-7e33-4c15-9c39-2638b58264fb None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:42.407960 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49877193-7e33-4c15-9c39-2638b58264fb None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:42.408371 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49877193-7e33-4c15-9c39-2638b58264fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:42.426473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-49877193-7e33-4c15-9c39-2638b58264fb None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:42.427660 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-49877193-7e33-4c15-9c39-2638b58264fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:42.491807 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:42.505131 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 399/805] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:42 2022] POST /identity/v3/auth/tokens => generated 1706 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:42.531210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5395b74-ff55-4911-bf6f-dbc622a822a3 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:42.638468 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5395b74-ff55-4911-bf6f-dbc622a822a3 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:42.672659 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ab488-0a18-4454-8b2b-aa9e3f61bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:42.673192 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab488-0a18-4454-8b2b-aa9e3f61bf32 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:42.673474 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab488-0a18-4454-8b2b-aa9e3f61bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:42.674269 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ab488-0a18-4454-8b2b-aa9e3f61bf32 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:42.674952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ab488-0a18-4454-8b2b-aa9e3f61bf32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:42.676587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ab488-0a18-4454-8b2b-aa9e3f61bf32 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:42.715032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.sql.core [None req-df1ab488-0a18-4454-8b2b-aa9e3f61bf32 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 15:12:42.715032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 15:12:42.715032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [parameters: {'user_id': '5d754f83a61f46a5a89004b868d22d0b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 15:12:42.715032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87488) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-df1ab488-0a18-4454-8b2b-aa9e3f61bf32 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application conn.query(q) Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application result.read() Jul 26 15:12:42.722403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 15:12:42.723370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application next(self.gen) Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application yield resource Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application next(self.gen) Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise self.value Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application session.commit() Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 15:12:42.724401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self.session.flush() Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application compat.raise_( Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 15:12:42.725282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 15:12:42.726165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application conn.query(q) Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application result.read() Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 15:12:42.727019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [parameters: {'user_id': '5d754f83a61f46a5a89004b868d22d0b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:42.727835 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 15:12:42.728656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 15:12:42.729570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 15:12:42.729570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 15:12:42.729570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 15:12:42.729570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 15:12:42.729570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 15:12:42.729570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:42.729570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 407/806] 10.222.0.100 () {60 vars in 1136 bytes} [Tue Jul 26 15:12:42 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:42.729959 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49877193-7e33-4c15-9c39-2638b58264fb None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:42.835651 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49877193-7e33-4c15-9c39-2638b58264fb None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:42.869133 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043891a-4a34-479a-b66d-0f82226fe00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:42.869765 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043891a-4a34-479a-b66d-0f82226fe00b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:42.870046 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043891a-4a34-479a-b66d-0f82226fe00b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:42.870317 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043891a-4a34-479a-b66d-0f82226fe00b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:42.878221 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043891a-4a34-479a-b66d-0f82226fe00b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:42.879711 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043891a-4a34-479a-b66d-0f82226fe00b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-6043891a-4a34-479a-b66d-0f82226fe00b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:12:42.891111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:42.892279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:42.893246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:42.893246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:42.893246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:12:42.893246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:12:42.893246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:12:42.893246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:12:42.893246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:12:42.893246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:12:42.893246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 15:12:42.893246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:42.896282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 400/807] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:12:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:42.898522 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ab488-0a18-4454-8b2b-aa9e3f61bf32 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:42.932411 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:43.000693 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ab488-0a18-4454-8b2b-aa9e3f61bf32 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:43.040958 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd1dff-57f8-4b23-9b73-5176c752386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:43.041824 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd1dff-57f8-4b23-9b73-5176c752386d None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:43.042104 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd1dff-57f8-4b23-9b73-5176c752386d None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:43.042373 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd1dff-57f8-4b23-9b73-5176c752386d None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:43.043123 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd1dff-57f8-4b23-9b73-5176c752386d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:43.043422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd1dff-57f8-4b23-9b73-5176c752386d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:43.045081 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd1dff-57f8-4b23-9b73-5176c752386d None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:43.086144 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 408/808] 10.222.0.100 () {56 vars in 1106 bytes} [Tue Jul 26 15:12:42 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:43.723211 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0afe1b-7cee-49aa-9e44-f8578de1464e None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:43.723728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0afe1b-7cee-49aa-9e44-f8578de1464e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:43.723728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0afe1b-7cee-49aa-9e44-f8578de1464e None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:43.725121 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 401/809] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:43.730251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072193f-bf7b-4e2f-a309-28fd20968664 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:43.730686 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072193f-bf7b-4e2f-a309-28fd20968664 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:43.730814 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072193f-bf7b-4e2f-a309-28fd20968664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:43.749567 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-9072193f-bf7b-4e2f-a309-28fd20968664 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:43.750999 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-9072193f-bf7b-4e2f-a309-28fd20968664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:43.821153 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 409/810] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:43 2022] POST /identity/v3/auth/tokens => generated 1706 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:43.844350 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0afe1b-7cee-49aa-9e44-f8578de1464e None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:43.897305 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:43.944355 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0afe1b-7cee-49aa-9e44-f8578de1464e None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:43.978363 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaead53-f9df-40ff-95f9-fec7e8dc6fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:43.978998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaead53-f9df-40ff-95f9-fec7e8dc6fd3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:43.979282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaead53-f9df-40ff-95f9-fec7e8dc6fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:43.979559 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaead53-f9df-40ff-95f9-fec7e8dc6fd3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:43.980213 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaead53-f9df-40ff-95f9-fec7e8dc6fd3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:43.981583 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaead53-f9df-40ff-95f9-fec7e8dc6fd3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-6aaead53-f9df-40ff-95f9-fec7e8dc6fd3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:43.990878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:43.992031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:12:43.993097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 402/811] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:43.998076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072193f-bf7b-4e2f-a309-28fd20968664 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:44.015291 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:44.099052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072193f-bf7b-4e2f-a309-28fd20968664 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:44.132712 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797887fe-6b12-479a-a849-b86476ce1d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:44.133320 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797887fe-6b12-479a-a849-b86476ce1d96 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:44.133603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797887fe-6b12-479a-a849-b86476ce1d96 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:44.133875 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797887fe-6b12-479a-a849-b86476ce1d96 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:44.134539 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797887fe-6b12-479a-a849-b86476ce1d96 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:44.134842 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797887fe-6b12-479a-a849-b86476ce1d96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:44.136261 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797887fe-6b12-479a-a849-b86476ce1d96 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:44.141107 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 410/812] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:43 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:44.147441 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaead53-f9df-40ff-95f9-fec7e8dc6fd3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:44.244052 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaead53-f9df-40ff-95f9-fec7e8dc6fd3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:44.259992 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:44.277681 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440be6b2-571a-4842-bc11-98f28c35d3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:44.278215 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440be6b2-571a-4842-bc11-98f28c35d3f8 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:44.278539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440be6b2-571a-4842-bc11-98f28c35d3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:44.278815 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440be6b2-571a-4842-bc11-98f28c35d3f8 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:44.279498 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440be6b2-571a-4842-bc11-98f28c35d3f8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:44.279798 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440be6b2-571a-4842-bc11-98f28c35d3f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:44.281195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440be6b2-571a-4842-bc11-98f28c35d3f8 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:44.286910 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 403/813] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:44 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:44.292735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797887fe-6b12-479a-a849-b86476ce1d96 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:44.380294 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:44.399452 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797887fe-6b12-479a-a849-b86476ce1d96 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:44.434219 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58ab45-be18-4a0a-967e-8c575b2cb734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:44.434827 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58ab45-be18-4a0a-967e-8c575b2cb734 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:44.435110 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58ab45-be18-4a0a-967e-8c575b2cb734 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:44.435387 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58ab45-be18-4a0a-967e-8c575b2cb734 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:44.436218 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58ab45-be18-4a0a-967e-8c575b2cb734 None admin] RBAC: Adding query filter params (interface=public, service_id=14449a187dbb4e5e951f9f7010075b0e, region_id=RegionOne) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:44.436534 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58ab45-be18-4a0a-967e-8c575b2cb734 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:44.437915 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58ab45-be18-4a0a-967e-8c575b2cb734 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:44.442881 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 411/814] 10.222.0.100 () {56 vars in 1256 bytes} [Tue Jul 26 15:12:44 2022] GET /identity/v3/endpoints?service_id=14449a187dbb4e5e951f9f7010075b0e&interface=public®ion_id=RegionOne => generated 195 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:44.448508 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440be6b2-571a-4842-bc11-98f28c35d3f8 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:44.548492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440be6b2-571a-4842-bc11-98f28c35d3f8 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:44.582973 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317170bf-8ead-4f7c-a95d-8e18c8aa2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:44.588965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317170bf-8ead-4f7c-a95d-8e18c8aa2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:44.588965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317170bf-8ead-4f7c-a95d-8e18c8aa2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:44.588965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317170bf-8ead-4f7c-a95d-8e18c8aa2fc3 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:44.588965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317170bf-8ead-4f7c-a95d-8e18c8aa2fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:44.588965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317170bf-8ead-4f7c-a95d-8e18c8aa2fc3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:44.592262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 404/815] 10.222.0.100 () {56 vars in 1092 bytes} [Tue Jul 26 15:12:44 2022] GET /identity/v3/services => generated 1736 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:12:46.865208 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee500a-13ac-49b1-8aaf-7b0af59ee835 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:46.865766 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee500a-13ac-49b1-8aaf-7b0af59ee835 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:46.866105 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee500a-13ac-49b1-8aaf-7b0af59ee835 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:46.868735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 412/816] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:12:46 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:12:46.874738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a54d-b481-41dc-a30f-838dd2258245 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:46.875199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a54d-b481-41dc-a30f-838dd2258245 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:46.875289 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a54d-b481-41dc-a30f-838dd2258245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:46.893717 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-8ac6a54d-b481-41dc-a30f-838dd2258245 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:12:46.894887 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-8ac6a54d-b481-41dc-a30f-838dd2258245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:12:46.933646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:46.961225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 405/817] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:12:46 2022] POST /identity/v3/auth/tokens => generated 1706 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:12:46.985859 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee500a-13ac-49b1-8aaf-7b0af59ee835 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:47.095981 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee500a-13ac-49b1-8aaf-7b0af59ee835 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:47.130097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4d6f3-95ea-4c83-8ae5-c937a9cf47a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:47.130728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4d6f3-95ea-4c83-8ae5-c937a9cf47a4 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:47.131025 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4d6f3-95ea-4c83-8ae5-c937a9cf47a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:47.131311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4d6f3-95ea-4c83-8ae5-c937a9cf47a4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:47.131936 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4d6f3-95ea-4c83-8ae5-c937a9cf47a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:47.133353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4d6f3-95ea-4c83-8ae5-c937a9cf47a4 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-d7b4d6f3-95ea-4c83-8ae5-c937a9cf47a4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:12:47.142042 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:12:47.143236 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:12:47.144090 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 413/818] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:12:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:12:47.150042 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a54d-b481-41dc-a30f-838dd2258245 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:47.249834 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a54d-b481-41dc-a30f-838dd2258245 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:47.283841 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32faa-2622-423b-9ee2-ab0a56d8cf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:47.284478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32faa-2622-423b-9ee2-ab0a56d8cf4c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:47.284765 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32faa-2622-423b-9ee2-ab0a56d8cf4c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:47.285042 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae32faa-2622-423b-9ee2-ab0a56d8cf4c None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:47.285723 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32faa-2622-423b-9ee2-ab0a56d8cf4c None admin] RBAC: Adding query filter params (name=compute) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:47.286027 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32faa-2622-423b-9ee2-ab0a56d8cf4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:47.287403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae32faa-2622-423b-9ee2-ab0a56d8cf4c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:47.292424 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 406/819] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:47 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:47.298287 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4d6f3-95ea-4c83-8ae5-c937a9cf47a4 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:47.309528 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:47.399258 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4d6f3-95ea-4c83-8ae5-c937a9cf47a4 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:47.432865 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e37ae-004f-41ec-bba3-6a934c767a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:47.433889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e37ae-004f-41ec-bba3-6a934c767a46 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:47.434373 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e37ae-004f-41ec-bba3-6a934c767a46 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:47.434831 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e37ae-004f-41ec-bba3-6a934c767a46 None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:47.436031 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e37ae-004f-41ec-bba3-6a934c767a46 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:12:47.436619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e37ae-004f-41ec-bba3-6a934c767a46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:47.439173 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e37ae-004f-41ec-bba3-6a934c767a46 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:47.446624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 414/820] 10.222.0.100 () {56 vars in 1117 bytes} [Tue Jul 26 15:12:47 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:12:47.452517 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32faa-2622-423b-9ee2-ab0a56d8cf4c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:12:47.491659 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:47.547961 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae32faa-2622-423b-9ee2-ab0a56d8cf4c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:12:47.581739 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eccad-7161-4e72-9893-2addb7b312ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:12:47.582337 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eccad-7161-4e72-9893-2addb7b312ee None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:12:47.582728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eccad-7161-4e72-9893-2addb7b312ee None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:12:47.582879 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eccad-7161-4e72-9893-2addb7b312ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:12:47.583579 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eccad-7161-4e72-9893-2addb7b312ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:12:47.584955 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eccad-7161-4e72-9893-2addb7b312ee None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:12:47.664089 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 407/821] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:12:47 2022] POST /identity/v3/endpoints => generated 336 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:12:57.443851 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=64 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:57.659810 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:15.281633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a812284-e15d-4188-a336-058a2c50313a None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:15.282232 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a812284-e15d-4188-a336-058a2c50313a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:15.282232 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a812284-e15d-4188-a336-058a2c50313a None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:15.283536 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 415/822] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:15.289353 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229279-82fa-4db1-bf37-850f63ef8aa7 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:15.307452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229279-82fa-4db1-bf37-850f63ef8aa7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:15.307452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f229279-82fa-4db1-bf37-850f63ef8aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:15.307914 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-9f229279-82fa-4db1-bf37-850f63ef8aa7 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:15.309137 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9f229279-82fa-4db1-bf37-850f63ef8aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:15.379041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 408/823] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:15 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:15.405914 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a812284-e15d-4188-a336-058a2c50313a None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:15.512032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a812284-e15d-4188-a336-058a2c50313a None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:15.547916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca7b41-e21b-4d5e-a1ef-49aa3ad2bae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:15.547916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca7b41-e21b-4d5e-a1ef-49aa3ad2bae1 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:15.547916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca7b41-e21b-4d5e-a1ef-49aa3ad2bae1 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:15.547916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca7b41-e21b-4d5e-a1ef-49aa3ad2bae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:15.557935 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca7b41-e21b-4d5e-a1ef-49aa3ad2bae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:15.559381 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca7b41-e21b-4d5e-a1ef-49aa3ad2bae1 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-9fca7b41-e21b-4d5e-a1ef-49aa3ad2bae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:15.574801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:15.575952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:15.577126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:15.577126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:15.577126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:15.577126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:15.577126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 416/824] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:15.583808 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f229279-82fa-4db1-bf37-850f63ef8aa7 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:15.682297 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f229279-82fa-4db1-bf37-850f63ef8aa7 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:15.710127 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:15.720891 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f955190-2732-43b4-b038-28c0539b605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:15.721514 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f955190-2732-43b4-b038-28c0539b605f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:15.721798 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f955190-2732-43b4-b038-28c0539b605f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:15.722076 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f955190-2732-43b4-b038-28c0539b605f None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:15.722770 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f955190-2732-43b4-b038-28c0539b605f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:15.723076 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f955190-2732-43b4-b038-28c0539b605f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:15.724629 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f955190-2732-43b4-b038-28c0539b605f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:15.735926 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 409/825] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:15.742343 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca7b41-e21b-4d5e-a1ef-49aa3ad2bae1 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:15.796546 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:15.855763 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca7b41-e21b-4d5e-a1ef-49aa3ad2bae1 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:15.876688 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b53438-93b3-42e3-baed-5d0f01fd2178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:15.877323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53438-93b3-42e3-baed-5d0f01fd2178 None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:15.877603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53438-93b3-42e3-baed-5d0f01fd2178 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:15.877876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53438-93b3-42e3-baed-5d0f01fd2178 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:15.878599 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b53438-93b3-42e3-baed-5d0f01fd2178 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:15.880552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b53438-93b3-42e3-baed-5d0f01fd2178 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:16.497066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 417/826] 10.222.0.100 () {60 vars in 1137 bytes} [Tue Jul 26 15:14:15 2022] POST /identity/v3/users => generated 252 bytes in 755 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:14:18.751707 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f7eb0-6e15-4f3c-b1f7-7334f6a12639 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:18.752261 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f7eb0-6e15-4f3c-b1f7-7334f6a12639 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:18.752261 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f7eb0-6e15-4f3c-b1f7-7334f6a12639 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:18.753553 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 410/827] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:18.758816 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a0e9d-6c51-4b06-921b-7201e5901900 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:18.759231 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a0e9d-6c51-4b06-921b-7201e5901900 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:18.759372 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a0e9d-6c51-4b06-921b-7201e5901900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:18.777706 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-837a0e9d-6c51-4b06-921b-7201e5901900 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:18.778916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-837a0e9d-6c51-4b06-921b-7201e5901900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:18.846262 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 418/828] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:18 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:18.871955 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f7eb0-6e15-4f3c-b1f7-7334f6a12639 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:18.976247 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f7eb0-6e15-4f3c-b1f7-7334f6a12639 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:19.010096 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094248a-94c2-4266-9128-f74e261e54cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:19.010688 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094248a-94c2-4266-9128-f74e261e54cd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:19.010970 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094248a-94c2-4266-9128-f74e261e54cd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:19.011246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094248a-94c2-4266-9128-f74e261e54cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:19.022152 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094248a-94c2-4266-9128-f74e261e54cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-8094248a-94c2-4266-9128-f74e261e54cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:14:19.026917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:19.028045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:19.028979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 411/829] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:14:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:19.034495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a0e9d-6c51-4b06-921b-7201e5901900 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:19.077349 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:19.138393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a0e9d-6c51-4b06-921b-7201e5901900 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:19.175440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9666ca6-3438-4e65-ab7b-e6b7419a992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:19.176070 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666ca6-3438-4e65-ab7b-e6b7419a992b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:19.176387 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666ca6-3438-4e65-ab7b-e6b7419a992b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:19.176661 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9666ca6-3438-4e65-ab7b-e6b7419a992b None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:19.177433 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9666ca6-3438-4e65-ab7b-e6b7419a992b None admin] RBAC: Adding query filter params (name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:19.177733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9666ca6-3438-4e65-ab7b-e6b7419a992b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:19.179100 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9666ca6-3438-4e65-ab7b-e6b7419a992b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:19.188688 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 419/830] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:14:19 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:19.195307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094248a-94c2-4266-9128-f74e261e54cd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:19.246036 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:19.304561 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094248a-94c2-4266-9128-f74e261e54cd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:19.338967 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3022f-ec07-4b34-a32d-53177819083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:19.339599 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3022f-ec07-4b34-a32d-53177819083b None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:19.339885 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3022f-ec07-4b34-a32d-53177819083b None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:19.340164 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3022f-ec07-4b34-a32d-53177819083b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:19.351772 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3022f-ec07-4b34-a32d-53177819083b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:19.353368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3022f-ec07-4b34-a32d-53177819083b None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-09c3022f-ec07-4b34-a32d-53177819083b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:19.368005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:19.369613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:19.370546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:19.370546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:19.370546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:19.370546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:19.370546 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 412/831] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:19.375051 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9666ca6-3438-4e65-ab7b-e6b7419a992b None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:19.492096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:19.495270 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9666ca6-3438-4e65-ab7b-e6b7419a992b None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:19.532984 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a2f4c-dc30-4b48-8d36-53c0387eda01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:19.533605 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a2f4c-dc30-4b48-8d36-53c0387eda01 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:19.533889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a2f4c-dc30-4b48-8d36-53c0387eda01 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:19.534164 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a2f4c-dc30-4b48-8d36-53c0387eda01 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:19.534856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a2f4c-dc30-4b48-8d36-53c0387eda01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:19.535159 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a2f4c-dc30-4b48-8d36-53c0387eda01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:19.536592 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a2f4c-dc30-4b48-8d36-53c0387eda01 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:19.548908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 420/832] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:19.558157 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3022f-ec07-4b34-a32d-53177819083b None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:19.653965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:19.657729 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3022f-ec07-4b34-a32d-53177819083b None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:19.689248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f471159-77f7-49d3-a532-7ec0df0d1add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:19.689870 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f471159-77f7-49d3-a532-7ec0df0d1add None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:19.690150 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f471159-77f7-49d3-a532-7ec0df0d1add None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:19.690422 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f471159-77f7-49d3-a532-7ec0df0d1add None admin] PATH_INFO: `/v3/users/placement` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:19.698136 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f471159-77f7-49d3-a532-7ec0df0d1add None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:19.699555 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f471159-77f7-49d3-a532-7ec0df0d1add None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-5f471159-77f7-49d3-a532-7ec0df0d1add None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:14:19.711200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:19.713896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:19.715124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 413/833] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:19.718561 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a2f4c-dc30-4b48-8d36-53c0387eda01 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:19.826957 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a2f4c-dc30-4b48-8d36-53c0387eda01 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:19.859938 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be5ca8-50ed-47ab-a4b5-5d6195511521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:19.860586 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5ca8-50ed-47ab-a4b5-5d6195511521 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:19.860930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5ca8-50ed-47ab-a4b5-5d6195511521 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:19.861211 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be5ca8-50ed-47ab-a4b5-5d6195511521 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:19.861999 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be5ca8-50ed-47ab-a4b5-5d6195511521 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:19.862310 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be5ca8-50ed-47ab-a4b5-5d6195511521 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:19.863755 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be5ca8-50ed-47ab-a4b5-5d6195511521 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:19.884550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 421/834] 10.222.0.100 () {56 vars in 1148 bytes} [Tue Jul 26 15:14:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:19.895400 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f471159-77f7-49d3-a532-7ec0df0d1add None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:19.998010 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f471159-77f7-49d3-a532-7ec0df0d1add None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:20.032424 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffdac1-41d0-4772-92d2-ef34a6f0a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:20.033159 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdac1-41d0-4772-92d2-ef34a6f0a808 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:20.033541 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdac1-41d0-4772-92d2-ef34a6f0a808 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:20.033926 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffdac1-41d0-4772-92d2-ef34a6f0a808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:20.101982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:20.126936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffdac1-41d0-4772-92d2-ef34a6f0a808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:20.133359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffdac1-41d0-4772-92d2-ef34a6f0a808 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:20.239501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 414/835] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:14:19 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:14:20.246066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be5ca8-50ed-47ab-a4b5-5d6195511521 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:20.266186 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:20.350213 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be5ca8-50ed-47ab-a4b5-5d6195511521 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:20.395267 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa317fe-00c3-41f7-a362-28f1821652df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:20.395901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa317fe-00c3-41f7-a362-28f1821652df None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:20.396224 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa317fe-00c3-41f7-a362-28f1821652df None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:20.396533 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa317fe-00c3-41f7-a362-28f1821652df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:20.408461 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa317fe-00c3-41f7-a362-28f1821652df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:20.409952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa317fe-00c3-41f7-a362-28f1821652df None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-4fa317fe-00c3-41f7-a362-28f1821652df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:20.433802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:20.435020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:20.436379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:20.436379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:20.436379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:20.436379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:20.436379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 422/836] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:20.441245 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffdac1-41d0-4772-92d2-ef34a6f0a808 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:20.509374 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:20.555191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffdac1-41d0-4772-92d2-ef34a6f0a808 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:20.588908 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721014f7-6b06-4dd7-82b2-13f8988139ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:20.589514 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721014f7-6b06-4dd7-82b2-13f8988139ac None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:20.589790 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721014f7-6b06-4dd7-82b2-13f8988139ac None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:20.590058 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721014f7-6b06-4dd7-82b2-13f8988139ac None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:20.590766 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721014f7-6b06-4dd7-82b2-13f8988139ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:20.591064 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721014f7-6b06-4dd7-82b2-13f8988139ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:20.592487 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721014f7-6b06-4dd7-82b2-13f8988139ac None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:20.604806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 415/837] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:20.610794 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa317fe-00c3-41f7-a362-28f1821652df None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:20.681878 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:20.716046 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa317fe-00c3-41f7-a362-28f1821652df None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:20.751871 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe4a76-ce73-4a9f-875c-4fe381563c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:20.752619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe4a76-ce73-4a9f-875c-4fe381563c75 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:20.752903 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe4a76-ce73-4a9f-875c-4fe381563c75 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:20.753274 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe4a76-ce73-4a9f-875c-4fe381563c75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:20.760245 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe4a76-ce73-4a9f-875c-4fe381563c75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:20.761719 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe4a76-ce73-4a9f-875c-4fe381563c75 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-11fe4a76-ce73-4a9f-875c-4fe381563c75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:14:20.774074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:20.775885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:20.777612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:14:20.777612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:14:20.777612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:14:20.777612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:14:20.777612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:14:20.777612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:14:20.777612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:20.777612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:20.777612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 423/838] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:14:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:20.781868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721014f7-6b06-4dd7-82b2-13f8988139ac None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:20.893021 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721014f7-6b06-4dd7-82b2-13f8988139ac None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:20.911392 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:20.928778 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e62b3-a421-49d5-a8ae-aada78143adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:20.929394 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e62b3-a421-49d5-a8ae-aada78143adf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:20.929676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e62b3-a421-49d5-a8ae-aada78143adf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:20.929950 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e62b3-a421-49d5-a8ae-aada78143adf None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:20.930703 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e62b3-a421-49d5-a8ae-aada78143adf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:20.931008 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e62b3-a421-49d5-a8ae-aada78143adf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:20.932846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e62b3-a421-49d5-a8ae-aada78143adf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:20.945295 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 416/839] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:14:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:20.951436 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe4a76-ce73-4a9f-875c-4fe381563c75 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:21.057930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe4a76-ce73-4a9f-875c-4fe381563c75 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:21.086829 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:21.092423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc8b3c-268c-41fd-ae02-31b1be1fff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:21.093028 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc8b3c-268c-41fd-ae02-31b1be1fff98 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:21.093307 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc8b3c-268c-41fd-ae02-31b1be1fff98 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:21.093662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc8b3c-268c-41fd-ae02-31b1be1fff98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:21.094484 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc8b3c-268c-41fd-ae02-31b1be1fff98 None admin] RBAC: Adding query filter params (role.id=58cdb402595a4191aa19b0b3a4ad8827, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=1fdf1646dad14825b7f78ba823af840f) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:21.094788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc8b3c-268c-41fd-ae02-31b1be1fff98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:21.096244 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc8b3c-268c-41fd-ae02-31b1be1fff98 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:21.101484 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 424/840] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:14:20 2022] GET /identity/v3/role_assignments?user.id=1fdf1646dad14825b7f78ba823af840f&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=58cdb402595a4191aa19b0b3a4ad8827 => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:23.355315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef3a1-694c-4b60-ab98-8dda039b6942 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:23.355850 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef3a1-694c-4b60-ab98-8dda039b6942 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:23.355963 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ef3a1-694c-4b60-ab98-8dda039b6942 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:23.357506 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 417/841] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:23.363187 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcbbce-50fc-41ab-bc6c-9d69c9715275 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:23.370308 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcbbce-50fc-41ab-bc6c-9d69c9715275 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:23.370308 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efcbbce-50fc-41ab-bc6c-9d69c9715275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:23.383451 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-2efcbbce-50fc-41ab-bc6c-9d69c9715275 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:23.384665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-2efcbbce-50fc-41ab-bc6c-9d69c9715275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:23.465149 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 425/842] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:23.496670 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ef3a1-694c-4b60-ab98-8dda039b6942 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:23.601009 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ef3a1-694c-4b60-ab98-8dda039b6942 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:23.635783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71206a-e7fc-4c85-857f-2216287eaf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:23.636377 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71206a-e7fc-4c85-857f-2216287eaf6c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:23.636662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71206a-e7fc-4c85-857f-2216287eaf6c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:23.636938 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71206a-e7fc-4c85-857f-2216287eaf6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:23.647593 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71206a-e7fc-4c85-857f-2216287eaf6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-2c71206a-e7fc-4c85-857f-2216287eaf6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:14:23.652447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:23.655515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:23.656617 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 418/843] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:14:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:23.660022 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efcbbce-50fc-41ab-bc6c-9d69c9715275 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:23.762394 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efcbbce-50fc-41ab-bc6c-9d69c9715275 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:23.786619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:23.798647 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d8e2-078d-417e-8068-a0bc8cf214de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:23.799262 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d8e2-078d-417e-8068-a0bc8cf214de None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:23.799545 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d8e2-078d-417e-8068-a0bc8cf214de None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:23.799823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d8e2-078d-417e-8068-a0bc8cf214de None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:23.800593 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d8e2-078d-417e-8068-a0bc8cf214de None admin] RBAC: Adding query filter params (name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:23.800941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d8e2-078d-417e-8068-a0bc8cf214de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:23.802385 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d8e2-078d-417e-8068-a0bc8cf214de None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:23.810257 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 426/844] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:14:23 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:23.816154 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71206a-e7fc-4c85-857f-2216287eaf6c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:23.857746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:23.915471 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71206a-e7fc-4c85-857f-2216287eaf6c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:23.951392 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb9e76-304e-4cee-a432-adb91aa9b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:23.952054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb9e76-304e-4cee-a432-adb91aa9b8de None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:23.952461 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb9e76-304e-4cee-a432-adb91aa9b8de None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:23.952738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb9e76-304e-4cee-a432-adb91aa9b8de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:23.964149 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb9e76-304e-4cee-a432-adb91aa9b8de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:23.965620 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb9e76-304e-4cee-a432-adb91aa9b8de None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-efeb9e76-304e-4cee-a432-adb91aa9b8de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:23.980250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:23.981349 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:23.982525 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:23.982525 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:23.982525 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:23.982525 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:23.988377 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 419/845] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:23.993947 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d8e2-078d-417e-8068-a0bc8cf214de None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:24.089209 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d8e2-078d-417e-8068-a0bc8cf214de None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:24.122423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86ee65-8967-4529-8e12-01d53ccb9df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:24.123030 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ee65-8967-4529-8e12-01d53ccb9df8 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:24.123311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ee65-8967-4529-8e12-01d53ccb9df8 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:24.123635 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86ee65-8967-4529-8e12-01d53ccb9df8 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:24.124385 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86ee65-8967-4529-8e12-01d53ccb9df8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:24.124731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86ee65-8967-4529-8e12-01d53ccb9df8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:24.126370 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86ee65-8967-4529-8e12-01d53ccb9df8 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:24.138679 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 427/846] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:24.144580 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb9e76-304e-4cee-a432-adb91aa9b8de None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:24.237306 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:24.247308 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb9e76-304e-4cee-a432-adb91aa9b8de None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:24.280215 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec338-8814-4f46-bef2-15141db406e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:24.280863 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec338-8814-4f46-bef2-15141db406e6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:24.281145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec338-8814-4f46-bef2-15141db406e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:24.281420 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec338-8814-4f46-bef2-15141db406e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:24.288950 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ec338-8814-4f46-bef2-15141db406e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:24.290394 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ec338-8814-4f46-bef2-15141db406e6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-1a5ec338-8814-4f46-bef2-15141db406e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:14:24.301738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:24.303332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:24.304428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 420/847] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:24.309304 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86ee65-8967-4529-8e12-01d53ccb9df8 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:24.358018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:24.411078 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86ee65-8967-4529-8e12-01d53ccb9df8 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:24.445996 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8f17d-ea07-4858-ab38-4f1c27d851b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:24.446602 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8f17d-ea07-4858-ab38-4f1c27d851b9 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:24.446880 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8f17d-ea07-4858-ab38-4f1c27d851b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:24.447152 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8f17d-ea07-4858-ab38-4f1c27d851b9 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:24.447934 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8f17d-ea07-4858-ab38-4f1c27d851b9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:24.448268 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8f17d-ea07-4858-ab38-4f1c27d851b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:24.449695 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8f17d-ea07-4858-ab38-4f1c27d851b9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:24.466418 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 428/848] 10.222.0.100 () {56 vars in 1148 bytes} [Tue Jul 26 15:14:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:24.472229 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec338-8814-4f46-bef2-15141db406e6 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:24.577442 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec338-8814-4f46-bef2-15141db406e6 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:24.610626 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0db80b-bf55-4012-9ccc-1e5097de1e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:24.611246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0db80b-bf55-4012-9ccc-1e5097de1e7c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:24.611523 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0db80b-bf55-4012-9ccc-1e5097de1e7c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:24.611794 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0db80b-bf55-4012-9ccc-1e5097de1e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:24.623188 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0db80b-bf55-4012-9ccc-1e5097de1e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:24.624672 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0db80b-bf55-4012-9ccc-1e5097de1e7c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-8e0db80b-bf55-4012-9ccc-1e5097de1e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:24.638805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:24.640178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:24.641590 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:24.641590 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:24.641590 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:24.641590 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:24.641590 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 421/849] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:24.645928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8f17d-ea07-4858-ab38-4f1c27d851b9 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:24.745612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8f17d-ea07-4858-ab38-4f1c27d851b9 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:24.747960 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:24.779164 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f5c6-bedb-4283-b189-6787fe4cdea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:24.779778 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f5c6-bedb-4283-b189-6787fe4cdea9 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:24.780055 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f5c6-bedb-4283-b189-6787fe4cdea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:24.780356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f5c6-bedb-4283-b189-6787fe4cdea9 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:24.781084 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f5c6-bedb-4283-b189-6787fe4cdea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:24.781383 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f5c6-bedb-4283-b189-6787fe4cdea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:24.782771 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f5c6-bedb-4283-b189-6787fe4cdea9 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:24.794716 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 429/850] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:24.801042 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0db80b-bf55-4012-9ccc-1e5097de1e7c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:24.804620 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:24.907619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0db80b-bf55-4012-9ccc-1e5097de1e7c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:24.941218 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e502-1292-4f4f-8224-c9fe51837969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:24.941856 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e502-1292-4f4f-8224-c9fe51837969 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:24.942143 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e502-1292-4f4f-8224-c9fe51837969 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:24.942421 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94e502-1292-4f4f-8224-c9fe51837969 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:24.949657 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e502-1292-4f4f-8224-c9fe51837969 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:24.952054 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94e502-1292-4f4f-8224-c9fe51837969 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-8c94e502-1292-4f4f-8224-c9fe51837969 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:14:24.963851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:24.968733 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:24.969665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:14:24.969665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:14:24.969665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:14:24.969665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:14:24.969665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:14:24.969665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:14:24.969665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:24.969665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:24.969665 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 422/851] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:24.971125 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f5c6-bedb-4283-b189-6787fe4cdea9 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:25.071526 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f5c6-bedb-4283-b189-6787fe4cdea9 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:25.106576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141e9f0-3674-4604-9880-632cdebd7ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:25.107185 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141e9f0-3674-4604-9880-632cdebd7ea1 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:25.107465 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141e9f0-3674-4604-9880-632cdebd7ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:25.107733 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141e9f0-3674-4604-9880-632cdebd7ea1 None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:25.108523 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141e9f0-3674-4604-9880-632cdebd7ea1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:25.108822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141e9f0-3674-4604-9880-632cdebd7ea1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:25.110362 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141e9f0-3674-4604-9880-632cdebd7ea1 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:25.122433 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 430/852] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:25.128960 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e502-1292-4f4f-8224-c9fe51837969 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:25.190390 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:25.229886 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94e502-1292-4f4f-8224-c9fe51837969 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:25.264442 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9383f6-063f-4a85-a16b-2f3ed02174a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:25.265103 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9383f6-063f-4a85-a16b-2f3ed02174a9 None admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:25.265382 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9383f6-063f-4a85-a16b-2f3ed02174a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:25.265653 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9383f6-063f-4a85-a16b-2f3ed02174a9 None admin] PATH_INFO: `/v3/projects/7bc4375bb14d42199565b224bef1242c/users/1fdf1646dad14825b7f78ba823af840f/roles/58cdb402595a4191aa19b0b3a4ad8827` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:25.280058 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9383f6-063f-4a85-a16b-2f3ed02174a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4375bb14d42199565b224bef1242c, user_id=1fdf1646dad14825b7f78ba823af840f, role_id=58cdb402595a4191aa19b0b3a4ad8827)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:25.281522 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9383f6-063f-4a85-a16b-2f3ed02174a9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:25.377123 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 423/853] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:14:25 2022] PUT /identity/v3/projects/7bc4375bb14d42199565b224bef1242c/users/1fdf1646dad14825b7f78ba823af840f/roles/58cdb402595a4191aa19b0b3a4ad8827 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:14:27.697497 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7750c-6ae0-4a8b-a80e-520000efee55 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:27.698099 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7750c-6ae0-4a8b-a80e-520000efee55 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:27.698244 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7750c-6ae0-4a8b-a80e-520000efee55 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:27.699844 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 431/854] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:27.705348 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57838-6089-4445-a1cd-efbc5dfb559e None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:27.705767 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57838-6089-4445-a1cd-efbc5dfb559e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:27.705899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57838-6089-4445-a1cd-efbc5dfb559e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:27.723930 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-f3e57838-6089-4445-a1cd-efbc5dfb559e None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:27.725158 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-f3e57838-6089-4445-a1cd-efbc5dfb559e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:27.789374 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 424/855] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:27 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:27.816326 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7750c-6ae0-4a8b-a80e-520000efee55 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:27.842487 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:27.924029 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7750c-6ae0-4a8b-a80e-520000efee55 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:27.959289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560b74-e456-47ce-a986-0763486b0914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:27.959930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560b74-e456-47ce-a986-0763486b0914 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:27.960246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560b74-e456-47ce-a986-0763486b0914 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:27.960525 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560b74-e456-47ce-a986-0763486b0914 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:27.970554 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac560b74-e456-47ce-a986-0763486b0914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-ac560b74-e456-47ce-a986-0763486b0914 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:14:27.975390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:27.976800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:27.977896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 432/856] 10.222.0.100 () {56 vars in 1107 bytes} [Tue Jul 26 15:14:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:27.982597 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57838-6089-4445-a1cd-efbc5dfb559e None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:28.025344 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:28.081060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57838-6089-4445-a1cd-efbc5dfb559e None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:28.115405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272a26-e4b7-4bd0-848a-fe4c4024f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:28.116020 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272a26-e4b7-4bd0-848a-fe4c4024f622 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:28.116350 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272a26-e4b7-4bd0-848a-fe4c4024f622 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:28.116625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272a26-e4b7-4bd0-848a-fe4c4024f622 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:28.117333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272a26-e4b7-4bd0-848a-fe4c4024f622 None admin] RBAC: Adding query filter params (name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:28.117636 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272a26-e4b7-4bd0-848a-fe4c4024f622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:28.119008 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3272a26-e4b7-4bd0-848a-fe4c4024f622 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:28.126728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 425/857] 10.222.0.100 () {56 vars in 1108 bytes} [Tue Jul 26 15:14:27 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:28.133549 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560b74-e456-47ce-a986-0763486b0914 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:28.221534 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:28.237142 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560b74-e456-47ce-a986-0763486b0914 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:28.271393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb795365-f63d-4bed-8147-a19ea4aee10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:28.272034 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb795365-f63d-4bed-8147-a19ea4aee10f None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:28.272344 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb795365-f63d-4bed-8147-a19ea4aee10f None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:28.272623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb795365-f63d-4bed-8147-a19ea4aee10f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:28.282852 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb795365-f63d-4bed-8147-a19ea4aee10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:28.284339 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb795365-f63d-4bed-8147-a19ea4aee10f None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-bb795365-f63d-4bed-8147-a19ea4aee10f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:28.298977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:28.300076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:28.301313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:28.301313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:28.301313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:28.301313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:28.301313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 433/858] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:28.306515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272a26-e4b7-4bd0-848a-fe4c4024f622 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:28.408487 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272a26-e4b7-4bd0-848a-fe4c4024f622 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:28.410655 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:28.442001 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c9bc7-9709-488f-9eae-2613939e69c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:28.442637 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c9bc7-9709-488f-9eae-2613939e69c0 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:28.442909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c9bc7-9709-488f-9eae-2613939e69c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:28.443673 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c9bc7-9709-488f-9eae-2613939e69c0 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:28.444438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c9bc7-9709-488f-9eae-2613939e69c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:28.444738 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c9bc7-9709-488f-9eae-2613939e69c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:28.446099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c9bc7-9709-488f-9eae-2613939e69c0 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:28.457456 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 426/859] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:28.463874 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb795365-f63d-4bed-8147-a19ea4aee10f None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:28.563267 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb795365-f63d-4bed-8147-a19ea4aee10f None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:28.598728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032444c-d008-4774-ae98-d24419709b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:28.599364 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032444c-d008-4774-ae98-d24419709b52 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:28.599644 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032444c-d008-4774-ae98-d24419709b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:28.599915 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032444c-d008-4774-ae98-d24419709b52 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:28.602611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:28.607541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032444c-d008-4774-ae98-d24419709b52 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:28.609048 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032444c-d008-4774-ae98-d24419709b52 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-5032444c-d008-4774-ae98-d24419709b52 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:14:28.620321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:28.621481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:28.622671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 434/860] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:28.627609 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c9bc7-9709-488f-9eae-2613939e69c0 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:28.724969 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c9bc7-9709-488f-9eae-2613939e69c0 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:28.761061 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b4ed6-473f-4b64-ac16-2e3f9c7710ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:28.761661 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b4ed6-473f-4b64-ac16-2e3f9c7710ed None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:28.761958 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b4ed6-473f-4b64-ac16-2e3f9c7710ed None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:28.762290 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b4ed6-473f-4b64-ac16-2e3f9c7710ed None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:28.763068 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b4ed6-473f-4b64-ac16-2e3f9c7710ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:28.763369 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b4ed6-473f-4b64-ac16-2e3f9c7710ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:28.764954 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b4ed6-473f-4b64-ac16-2e3f9c7710ed None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:28.781486 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 427/861] 10.222.0.100 () {56 vars in 1148 bytes} [Tue Jul 26 15:14:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:28.787648 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032444c-d008-4774-ae98-d24419709b52 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:28.888219 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032444c-d008-4774-ae98-d24419709b52 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:28.922367 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfaaf2-314d-47e8-ae82-9283d91a4fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:28.923023 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfaaf2-314d-47e8-ae82-9283d91a4fe3 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:28.923307 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfaaf2-314d-47e8-ae82-9283d91a4fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:28.923582 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfaaf2-314d-47e8-ae82-9283d91a4fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:28.986144 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:28.993621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfaaf2-314d-47e8-ae82-9283d91a4fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:28.995144 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfaaf2-314d-47e8-ae82-9283d91a4fe3 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:29.098922 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 435/862] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:14:28 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:14:29.105245 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b4ed6-473f-4b64-ac16-2e3f9c7710ed None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:29.130145 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:29.206228 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b4ed6-473f-4b64-ac16-2e3f9c7710ed None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:29.239182 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731972d-82c1-4f8b-9d9d-a3b3f28e886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:29.240075 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731972d-82c1-4f8b-9d9d-a3b3f28e886f None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:29.240745 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731972d-82c1-4f8b-9d9d-a3b3f28e886f None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:29.240998 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731972d-82c1-4f8b-9d9d-a3b3f28e886f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:29.251211 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731972d-82c1-4f8b-9d9d-a3b3f28e886f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:29.253327 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731972d-82c1-4f8b-9d9d-a3b3f28e886f None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-7731972d-82c1-4f8b-9d9d-a3b3f28e886f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:29.268260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:29.269323 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:29.270326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:29.270326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:29.270326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:29.270326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:29.270326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 428/863] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:29.275219 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfaaf2-314d-47e8-ae82-9283d91a4fe3 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:29.372266 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:29.377939 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfaaf2-314d-47e8-ae82-9283d91a4fe3 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:29.411482 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf0e82-8100-422b-a412-f78a76e7e085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:29.412647 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf0e82-8100-422b-a412-f78a76e7e085 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:29.412930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf0e82-8100-422b-a412-f78a76e7e085 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:29.413207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf0e82-8100-422b-a412-f78a76e7e085 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:29.413884 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf0e82-8100-422b-a412-f78a76e7e085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:29.414185 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf0e82-8100-422b-a412-f78a76e7e085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:29.415550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf0e82-8100-422b-a412-f78a76e7e085 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:29.426860 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 436/864] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:29.434499 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731972d-82c1-4f8b-9d9d-a3b3f28e886f None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:29.510533 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:29.534632 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731972d-82c1-4f8b-9d9d-a3b3f28e886f None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:29.568291 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119f4a4-15ae-4dd3-88f9-8397ee61967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:29.568929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119f4a4-15ae-4dd3-88f9-8397ee61967d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:29.569211 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119f4a4-15ae-4dd3-88f9-8397ee61967d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:29.569484 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119f4a4-15ae-4dd3-88f9-8397ee61967d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:29.576212 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119f4a4-15ae-4dd3-88f9-8397ee61967d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:29.577654 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119f4a4-15ae-4dd3-88f9-8397ee61967d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-3119f4a4-15ae-4dd3-88f9-8397ee61967d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:14:29.590315 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:29.591575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:29.595943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:14:29.595943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:14:29.595943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:14:29.595943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:14:29.595943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:14:29.595943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:14:29.595943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:29.595943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:29.595943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 429/865] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:14:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:14:29.597542 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf0e82-8100-422b-a412-f78a76e7e085 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:29.703143 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf0e82-8100-422b-a412-f78a76e7e085 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:29.736511 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eb639-14e7-4126-add0-60ba966c1959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:29.737118 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eb639-14e7-4126-add0-60ba966c1959 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:29.737397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eb639-14e7-4126-add0-60ba966c1959 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:29.737669 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eb639-14e7-4126-add0-60ba966c1959 None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:29.738410 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eb639-14e7-4126-add0-60ba966c1959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:29.738710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eb639-14e7-4126-add0-60ba966c1959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:29.740720 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eb639-14e7-4126-add0-60ba966c1959 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:29.752581 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 437/866] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:14:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:29.759452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119f4a4-15ae-4dd3-88f9-8397ee61967d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:29.859672 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119f4a4-15ae-4dd3-88f9-8397ee61967d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:29.893785 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55159f0f-e8a2-46f1-9b6f-0f1e9a6855fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:29.894410 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159f0f-e8a2-46f1-9b6f-0f1e9a6855fc None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:29.894692 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159f0f-e8a2-46f1-9b6f-0f1e9a6855fc None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:29.894964 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159f0f-e8a2-46f1-9b6f-0f1e9a6855fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:29.895755 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159f0f-e8a2-46f1-9b6f-0f1e9a6855fc None admin] RBAC: Adding query filter params (role.id=58cdb402595a4191aa19b0b3a4ad8827, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=1fdf1646dad14825b7f78ba823af840f) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:29.896064 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159f0f-e8a2-46f1-9b6f-0f1e9a6855fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:29.897551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159f0f-e8a2-46f1-9b6f-0f1e9a6855fc None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:29.899446 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:29.903940 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 430/867] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:14:29 2022] GET /identity/v3/role_assignments?user.id=1fdf1646dad14825b7f78ba823af840f&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=58cdb402595a4191aa19b0b3a4ad8827 => generated 610 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:14:32.299888 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b209ef-c20b-4a64-945d-1af074c7b2dc None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:32.300518 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b209ef-c20b-4a64-945d-1af074c7b2dc None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:32.300518 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b209ef-c20b-4a64-945d-1af074c7b2dc None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:32.301933 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 438/868] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:32.307249 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaf817-1f8e-4900-a0a0-f081fc460109 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:32.309784 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaf817-1f8e-4900-a0a0-f081fc460109 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:32.309784 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaf817-1f8e-4900-a0a0-f081fc460109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:32.326874 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-fbcaf817-1f8e-4900-a0a0-f081fc460109 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:32.328184 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-fbcaf817-1f8e-4900-a0a0-f081fc460109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:32.394995 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 431/869] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:32 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:32.419980 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b209ef-c20b-4a64-945d-1af074c7b2dc None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:32.445246 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:32.532427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b209ef-c20b-4a64-945d-1af074c7b2dc None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:32.566233 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424766d-8271-4f15-86d3-6d3c62db3c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:32.566795 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424766d-8271-4f15-86d3-6d3c62db3c1a None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:32.567087 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424766d-8271-4f15-86d3-6d3c62db3c1a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:32.567364 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424766d-8271-4f15-86d3-6d3c62db3c1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:32.577875 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424766d-8271-4f15-86d3-6d3c62db3c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-b424766d-8271-4f15-86d3-6d3c62db3c1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:14:32.582668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:32.583777 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:32.584801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 439/870] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:14:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 15:14:32.589996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaf817-1f8e-4900-a0a0-f081fc460109 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:32.687746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaf817-1f8e-4900-a0a0-f081fc460109 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:32.713396 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:32.724614 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ba5ee-55c2-4d17-9cdd-cb0c96a2d38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:32.725234 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ba5ee-55c2-4d17-9cdd-cb0c96a2d38d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:32.725516 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ba5ee-55c2-4d17-9cdd-cb0c96a2d38d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:32.725791 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ba5ee-55c2-4d17-9cdd-cb0c96a2d38d None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:32.726505 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ba5ee-55c2-4d17-9cdd-cb0c96a2d38d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:32.726806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ba5ee-55c2-4d17-9cdd-cb0c96a2d38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:32.728194 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ba5ee-55c2-4d17-9cdd-cb0c96a2d38d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:32.736310 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 432/871] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:14:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:32.742869 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424766d-8271-4f15-86d3-6d3c62db3c1a None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:32.822021 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:32.844379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424766d-8271-4f15-86d3-6d3c62db3c1a None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:32.877881 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018529d-8cc6-44aa-87c8-c32063bc0142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:32.878505 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018529d-8cc6-44aa-87c8-c32063bc0142 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:32.878866 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018529d-8cc6-44aa-87c8-c32063bc0142 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:32.879276 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018529d-8cc6-44aa-87c8-c32063bc0142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:32.891349 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018529d-8cc6-44aa-87c8-c32063bc0142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:32.893032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018529d-8cc6-44aa-87c8-c32063bc0142 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-2018529d-8cc6-44aa-87c8-c32063bc0142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:32.907508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:32.908480 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:32.909685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:32.909685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:32.909685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:32.909685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:32.909685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 440/872] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:32.915242 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ba5ee-55c2-4d17-9cdd-cb0c96a2d38d None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:33.014545 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ba5ee-55c2-4d17-9cdd-cb0c96a2d38d None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:33.048803 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a11d1-752c-4b64-8ec6-a029b25af449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:33.049412 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a11d1-752c-4b64-8ec6-a029b25af449 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:33.049696 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a11d1-752c-4b64-8ec6-a029b25af449 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:33.050172 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a11d1-752c-4b64-8ec6-a029b25af449 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:33.050753 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a11d1-752c-4b64-8ec6-a029b25af449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:33.051051 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a11d1-752c-4b64-8ec6-a029b25af449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:33.052450 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a11d1-752c-4b64-8ec6-a029b25af449 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:33.065479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 433/873] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:33.071834 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018529d-8cc6-44aa-87c8-c32063bc0142 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:33.178171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018529d-8cc6-44aa-87c8-c32063bc0142 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:33.204907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:33.213204 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624fa54-4976-436a-b897-0102fe61a29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:33.213836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fa54-4976-436a-b897-0102fe61a29b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:33.214117 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fa54-4976-436a-b897-0102fe61a29b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:33.214393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624fa54-4976-436a-b897-0102fe61a29b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:33.221819 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624fa54-4976-436a-b897-0102fe61a29b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:33.223256 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624fa54-4976-436a-b897-0102fe61a29b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-2624fa54-4976-436a-b897-0102fe61a29b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:14:33.234916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:33.235949 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:33.237077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 441/874] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:33.242905 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a11d1-752c-4b64-8ec6-a029b25af449 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:33.294780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:33.343049 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a11d1-752c-4b64-8ec6-a029b25af449 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:33.376166 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505f6d-2abb-426d-9fb5-d9a4da98b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:33.376775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505f6d-2abb-426d-9fb5-d9a4da98b234 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:33.377141 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505f6d-2abb-426d-9fb5-d9a4da98b234 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:33.377327 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21505f6d-2abb-426d-9fb5-d9a4da98b234 None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:33.378106 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21505f6d-2abb-426d-9fb5-d9a4da98b234 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:33.378409 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21505f6d-2abb-426d-9fb5-d9a4da98b234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:33.379903 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21505f6d-2abb-426d-9fb5-d9a4da98b234 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:33.398734 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 434/875] 10.222.0.100 () {56 vars in 1148 bytes} [Tue Jul 26 15:14:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:33.405158 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624fa54-4976-436a-b897-0102fe61a29b None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:33.510113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624fa54-4976-436a-b897-0102fe61a29b None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:33.545531 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e335ec-9b44-4810-98f1-30c44d467b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:33.546657 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e335ec-9b44-4810-98f1-30c44d467b37 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:33.547039 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e335ec-9b44-4810-98f1-30c44d467b37 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:33.547361 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e335ec-9b44-4810-98f1-30c44d467b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:33.606701 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:33.619639 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e335ec-9b44-4810-98f1-30c44d467b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:33.621851 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e335ec-9b44-4810-98f1-30c44d467b37 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:33.721115 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 442/876] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:14:33 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 15:14:33.726854 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505f6d-2abb-426d-9fb5-d9a4da98b234 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:33.828053 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21505f6d-2abb-426d-9fb5-d9a4da98b234 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:33.838098 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:33.865468 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d2012-ea1b-4d6b-8d03-aee9d34c674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:33.866098 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d2012-ea1b-4d6b-8d03-aee9d34c674c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:33.866375 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d2012-ea1b-4d6b-8d03-aee9d34c674c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:33.866645 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d2012-ea1b-4d6b-8d03-aee9d34c674c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:33.876526 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d2012-ea1b-4d6b-8d03-aee9d34c674c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:33.877955 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d2012-ea1b-4d6b-8d03-aee9d34c674c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-833d2012-ea1b-4d6b-8d03-aee9d34c674c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:33.892501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:33.893565 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:33.894489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:33.894489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:33.894489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:33.894489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:33.894489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 435/877] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:33.901047 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e335ec-9b44-4810-98f1-30c44d467b37 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:34.000564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:34.013228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e335ec-9b44-4810-98f1-30c44d467b37 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:34.048665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27a796-cbda-4a05-8dbb-7749c78cdb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:34.049273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27a796-cbda-4a05-8dbb-7749c78cdb10 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:34.049555 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27a796-cbda-4a05-8dbb-7749c78cdb10 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:34.049827 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27a796-cbda-4a05-8dbb-7749c78cdb10 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:34.050505 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27a796-cbda-4a05-8dbb-7749c78cdb10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:34.050806 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27a796-cbda-4a05-8dbb-7749c78cdb10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:34.052191 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27a796-cbda-4a05-8dbb-7749c78cdb10 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:34.063942 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 443/878] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:34.070771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d2012-ea1b-4d6b-8d03-aee9d34c674c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:34.173057 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d2012-ea1b-4d6b-8d03-aee9d34c674c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:34.206432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbace3-8214-45c7-a337-9e0cf6b4b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:34.207063 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbace3-8214-45c7-a337-9e0cf6b4b0bd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:34.207345 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbace3-8214-45c7-a337-9e0cf6b4b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:34.207619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbace3-8214-45c7-a337-9e0cf6b4b0bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:34.214094 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbace3-8214-45c7-a337-9e0cf6b4b0bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:34.216962 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbace3-8214-45c7-a337-9e0cf6b4b0bd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-7edbace3-8214-45c7-a337-9e0cf6b4b0bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:14:34.226666 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:34.227720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:34.228832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:14:34.228832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:14:34.228832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:14:34.228832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:14:34.228832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:14:34.228832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:14:34.228832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:34.228832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:34.228832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 436/879] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:34.234357 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27a796-cbda-4a05-8dbb-7749c78cdb10 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:34.345266 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27a796-cbda-4a05-8dbb-7749c78cdb10 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:34.379390 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8fc4e-8e75-4522-bf38-cb3c29960689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:34.380000 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8fc4e-8e75-4522-bf38-cb3c29960689 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:34.380318 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8fc4e-8e75-4522-bf38-cb3c29960689 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:34.380719 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8fc4e-8e75-4522-bf38-cb3c29960689 None admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:34.381489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8fc4e-8e75-4522-bf38-cb3c29960689 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:34.381889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8fc4e-8e75-4522-bf38-cb3c29960689 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:34.383317 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8fc4e-8e75-4522-bf38-cb3c29960689 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:34.395619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 444/880] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:34.401774 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbace3-8214-45c7-a337-9e0cf6b4b0bd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:34.424427 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:34.499948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbace3-8214-45c7-a337-9e0cf6b4b0bd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:34.533980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd53ad2-8777-4d49-a1f0-a07308782eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:34.534515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd53ad2-8777-4d49-a1f0-a07308782eb6 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:34.534792 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd53ad2-8777-4d49-a1f0-a07308782eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:34.535063 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd53ad2-8777-4d49-a1f0-a07308782eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:34.535839 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd53ad2-8777-4d49-a1f0-a07308782eb6 None admin] RBAC: Adding query filter params (role.id=6d23401ca57e47398bf036ea320a7617, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=1fdf1646dad14825b7f78ba823af840f) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:34.536175 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd53ad2-8777-4d49-a1f0-a07308782eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:34.538129 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd53ad2-8777-4d49-a1f0-a07308782eb6 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:34.543333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 437/881] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:14:34 2022] GET /identity/v3/role_assignments?user.id=1fdf1646dad14825b7f78ba823af840f&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=6d23401ca57e47398bf036ea320a7617 => generated 260 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:14:36.765321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94b7fe-56c3-4ed9-8282-9dc81e5703f6 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:36.765827 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94b7fe-56c3-4ed9-8282-9dc81e5703f6 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:36.765827 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94b7fe-56c3-4ed9-8282-9dc81e5703f6 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:36.767117 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 445/882] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:36.772976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3fc7-2d52-4041-91eb-2dc37f9f7513 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:36.773413 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3fc7-2d52-4041-91eb-2dc37f9f7513 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:36.773528 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff3fc7-2d52-4041-91eb-2dc37f9f7513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:36.791445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-aeff3fc7-2d52-4041-91eb-2dc37f9f7513 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:36.795831 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-aeff3fc7-2d52-4041-91eb-2dc37f9f7513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:36.858368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 438/883] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:36 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:36.882526 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94b7fe-56c3-4ed9-8282-9dc81e5703f6 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:36.893658 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:36.987800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94b7fe-56c3-4ed9-8282-9dc81e5703f6 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:37.024904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841712-ee54-4052-9065-93c31c2f9b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:37.024904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841712-ee54-4052-9065-93c31c2f9b23 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:37.024904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841712-ee54-4052-9065-93c31c2f9b23 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:37.024904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841712-ee54-4052-9065-93c31c2f9b23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:37.033678 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841712-ee54-4052-9065-93c31c2f9b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-0f841712-ee54-4052-9065-93c31c2f9b23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:14:37.038591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:37.039710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:37.040632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 446/884] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:37.045886 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3fc7-2d52-4041-91eb-2dc37f9f7513 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:37.061645 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:37.143378 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff3fc7-2d52-4041-91eb-2dc37f9f7513 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:37.178209 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9923b-918b-46d7-9071-e6560904f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:37.178818 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9923b-918b-46d7-9071-e6560904f952 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:37.179096 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9923b-918b-46d7-9071-e6560904f952 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:37.179368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9923b-918b-46d7-9071-e6560904f952 None admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:37.180078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9923b-918b-46d7-9071-e6560904f952 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:37.180411 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9923b-918b-46d7-9071-e6560904f952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:37.181778 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9923b-918b-46d7-9071-e6560904f952 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:37.190166 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 439/885] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:14:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:37.196642 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841712-ee54-4052-9065-93c31c2f9b23 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:37.265923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:37.298301 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841712-ee54-4052-9065-93c31c2f9b23 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:37.331884 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c22a6d-b0de-468f-9343-c5046ffa299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:37.332548 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c22a6d-b0de-468f-9343-c5046ffa299c None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:37.332832 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c22a6d-b0de-468f-9343-c5046ffa299c None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:37.333109 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c22a6d-b0de-468f-9343-c5046ffa299c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:37.342963 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c22a6d-b0de-468f-9343-c5046ffa299c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:37.344442 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c22a6d-b0de-468f-9343-c5046ffa299c None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-03c22a6d-b0de-468f-9343-c5046ffa299c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:37.359138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:37.360096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:37.361128 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:37.361128 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:37.361128 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:37.361128 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:37.361128 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 447/886] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:37.367302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9923b-918b-46d7-9071-e6560904f952 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:37.443877 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:37.465860 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9923b-918b-46d7-9071-e6560904f952 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:37.499585 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18430f2-9da1-49f1-bde9-8b899cc9eabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:37.500295 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18430f2-9da1-49f1-bde9-8b899cc9eabd None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:37.500581 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18430f2-9da1-49f1-bde9-8b899cc9eabd None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:37.500859 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18430f2-9da1-49f1-bde9-8b899cc9eabd None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:37.501545 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18430f2-9da1-49f1-bde9-8b899cc9eabd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:37.501852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18430f2-9da1-49f1-bde9-8b899cc9eabd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:37.503216 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18430f2-9da1-49f1-bde9-8b899cc9eabd None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:37.514840 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 440/887] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:37.520590 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c22a6d-b0de-468f-9343-c5046ffa299c None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:37.635529 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c22a6d-b0de-468f-9343-c5046ffa299c None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:37.655715 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:37.669399 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbe503-5089-4027-9d05-94a313558304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:37.670032 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbe503-5089-4027-9d05-94a313558304 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:37.670315 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbe503-5089-4027-9d05-94a313558304 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:37.670594 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbe503-5089-4027-9d05-94a313558304 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:37.679048 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbe503-5089-4027-9d05-94a313558304 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:37.682486 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbe503-5089-4027-9d05-94a313558304 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-2bfbe503-5089-4027-9d05-94a313558304 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:14:37.691292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:37.692380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:37.694012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 448/888] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:37.698835 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18430f2-9da1-49f1-bde9-8b899cc9eabd None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:37.801920 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18430f2-9da1-49f1-bde9-8b899cc9eabd None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:37.836391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514e844-1a76-4829-a0e7-05c731b8bc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:37.836994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514e844-1a76-4829-a0e7-05c731b8bc6c None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:37.837270 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514e844-1a76-4829-a0e7-05c731b8bc6c None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:37.837544 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514e844-1a76-4829-a0e7-05c731b8bc6c None admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:37.838321 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514e844-1a76-4829-a0e7-05c731b8bc6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:37.838624 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514e844-1a76-4829-a0e7-05c731b8bc6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:37.840108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514e844-1a76-4829-a0e7-05c731b8bc6c None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:37.842724 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:37.857744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 441/889] 10.222.0.100 () {56 vars in 1148 bytes} [Tue Jul 26 15:14:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:37.864813 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbe503-5089-4027-9d05-94a313558304 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:37.979354 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbe503-5089-4027-9d05-94a313558304 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:38.014476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f984e-6f74-4c96-bbc8-715c04da8bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:38.015108 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f984e-6f74-4c96-bbc8-715c04da8bc1 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:38.015392 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f984e-6f74-4c96-bbc8-715c04da8bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:38.015670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f984e-6f74-4c96-bbc8-715c04da8bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:38.026710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f984e-6f74-4c96-bbc8-715c04da8bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:38.028210 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f984e-6f74-4c96-bbc8-715c04da8bc1 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-770f984e-6f74-4c96-bbc8-715c04da8bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:38.042668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:38.043627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:38.044600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:38.044600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:38.044600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:38.044600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:38.044600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 449/890] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:38.049861 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514e844-1a76-4829-a0e7-05c731b8bc6c None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:38.151411 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514e844-1a76-4829-a0e7-05c731b8bc6c None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:38.184874 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d7c5-b952-4ab1-8d05-2a91389b27b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:38.185572 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d7c5-b952-4ab1-8d05-2a91389b27b3 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:38.185849 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d7c5-b952-4ab1-8d05-2a91389b27b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:38.186117 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d7c5-b952-4ab1-8d05-2a91389b27b3 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:38.186802 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548d7c5-b952-4ab1-8d05-2a91389b27b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:38.187100 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548d7c5-b952-4ab1-8d05-2a91389b27b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:38.188633 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548d7c5-b952-4ab1-8d05-2a91389b27b3 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:38.200777 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 442/891] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:38.206506 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f984e-6f74-4c96-bbc8-715c04da8bc1 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:38.238072 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:38.336435 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f984e-6f74-4c96-bbc8-715c04da8bc1 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:38.371772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc1e1a-e891-4b0e-ad2f-87fd0857b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:38.372427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1e1a-e891-4b0e-ad2f-87fd0857b96a None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:38.372707 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1e1a-e891-4b0e-ad2f-87fd0857b96a None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:38.372977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1e1a-e891-4b0e-ad2f-87fd0857b96a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:38.379413 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc1e1a-e891-4b0e-ad2f-87fd0857b96a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:38.381422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc1e1a-e891-4b0e-ad2f-87fd0857b96a None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-33cc1e1a-e891-4b0e-ad2f-87fd0857b96a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:14:38.392485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:38.394444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:38.395397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:14:38.395397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:14:38.395397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:14:38.395397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:14:38.395397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:14:38.395397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:14:38.395397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:38.395397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:38.395397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 450/892] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:38.400246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d7c5-b952-4ab1-8d05-2a91389b27b3 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:38.456371 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:38.500577 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d7c5-b952-4ab1-8d05-2a91389b27b3 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:38.532498 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97595e-59ac-4271-8005-5fea2973da3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:38.533113 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97595e-59ac-4271-8005-5fea2973da3d None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:38.533396 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97595e-59ac-4271-8005-5fea2973da3d None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:38.533673 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97595e-59ac-4271-8005-5fea2973da3d None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:38.534412 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97595e-59ac-4271-8005-5fea2973da3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:38.534720 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97595e-59ac-4271-8005-5fea2973da3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:38.536169 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97595e-59ac-4271-8005-5fea2973da3d None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:38.548034 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 443/893] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:38.554774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc1e1a-e891-4b0e-ad2f-87fd0857b96a None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:38.655709 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:38.666642 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc1e1a-e891-4b0e-ad2f-87fd0857b96a None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:38.703917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882f41b-e466-4eb2-bd41-e2e110b7ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:38.704818 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f41b-e466-4eb2-bd41-e2e110b7ce19 None admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:38.705100 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f41b-e466-4eb2-bd41-e2e110b7ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:38.705375 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f41b-e466-4eb2-bd41-e2e110b7ce19 None admin] PATH_INFO: `/v3/projects/7bc4375bb14d42199565b224bef1242c/users/1fdf1646dad14825b7f78ba823af840f/roles/6d23401ca57e47398bf036ea320a7617` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:38.707339 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882f41b-e466-4eb2-bd41-e2e110b7ce19 None admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4375bb14d42199565b224bef1242c, user_id=1fdf1646dad14825b7f78ba823af840f, role_id=6d23401ca57e47398bf036ea320a7617)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:38.708825 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882f41b-e466-4eb2-bd41-e2e110b7ce19 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:38.864689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 451/894] 10.222.0.100 () {58 vars in 1444 bytes} [Tue Jul 26 15:14:38 2022] PUT /identity/v3/projects/7bc4375bb14d42199565b224bef1242c/users/1fdf1646dad14825b7f78ba823af840f/roles/6d23401ca57e47398bf036ea320a7617 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:14:41.112434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4439e-95d2-4e71-b7be-5f0f2c9ac013 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:41.112965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4439e-95d2-4e71-b7be-5f0f2c9ac013 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:41.112965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4439e-95d2-4e71-b7be-5f0f2c9ac013 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:41.114338 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 444/895] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:41.119383 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33823b96-2537-40ac-bf58-dbd8f6d1f06b None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:41.119813 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33823b96-2537-40ac-bf58-dbd8f6d1f06b None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:41.119964 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33823b96-2537-40ac-bf58-dbd8f6d1f06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:41.138498 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-33823b96-2537-40ac-bf58-dbd8f6d1f06b None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:41.139694 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-33823b96-2537-40ac-bf58-dbd8f6d1f06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:41.206170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 452/896] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:41 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:41.231481 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4439e-95d2-4e71-b7be-5f0f2c9ac013 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:41.330815 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4439e-95d2-4e71-b7be-5f0f2c9ac013 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:41.345165 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:41.364598 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa64d0f-5852-4090-bb44-c2dccaffe908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:41.365153 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64d0f-5852-4090-bb44-c2dccaffe908 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:41.365458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64d0f-5852-4090-bb44-c2dccaffe908 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:41.365732 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64d0f-5852-4090-bb44-c2dccaffe908 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:41.375486 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa64d0f-5852-4090-bb44-c2dccaffe908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-cfa64d0f-5852-4090-bb44-c2dccaffe908 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 15:14:41.380417 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:41.381982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:41.382864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 445/897] 10.222.0.100 () {56 vars in 1101 bytes} [Tue Jul 26 15:14:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:41.388128 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33823b96-2537-40ac-bf58-dbd8f6d1f06b None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:41.471299 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:41.489318 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33823b96-2537-40ac-bf58-dbd8f6d1f06b None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:41.524894 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdc539-8199-438f-b6c1-77c6f05bedaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:41.525520 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdc539-8199-438f-b6c1-77c6f05bedaa None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:41.525802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdc539-8199-438f-b6c1-77c6f05bedaa None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:41.526074 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdc539-8199-438f-b6c1-77c6f05bedaa None admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:41.526785 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdc539-8199-438f-b6c1-77c6f05bedaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:41.527086 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdc539-8199-438f-b6c1-77c6f05bedaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:41.528493 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdc539-8199-438f-b6c1-77c6f05bedaa None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:41.537564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 453/898] 10.222.0.100 () {56 vars in 1104 bytes} [Tue Jul 26 15:14:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:41.543496 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa64d0f-5852-4090-bb44-c2dccaffe908 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:41.642610 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa64d0f-5852-4090-bb44-c2dccaffe908 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:41.675743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cc665-f66e-48bc-9776-6c467377dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:41.676400 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc665-f66e-48bc-9776-6c467377dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:41.676681 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc665-f66e-48bc-9776-6c467377dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:41.676955 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc665-f66e-48bc-9776-6c467377dbd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:41.687743 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cc665-f66e-48bc-9776-6c467377dbd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:41.689232 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cc665-f66e-48bc-9776-6c467377dbd9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-b41cc665-f66e-48bc-9776-6c467377dbd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:41.703793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:41.704985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:41.705895 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:41.705895 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:41.705895 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:41.705895 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:41.705895 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 446/899] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:41.711327 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdc539-8199-438f-b6c1-77c6f05bedaa None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:41.814723 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdc539-8199-438f-b6c1-77c6f05bedaa None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:41.848654 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551c2e9-60b8-476b-8145-2735bf3026c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:41.849284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c2e9-60b8-476b-8145-2735bf3026c1 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:41.849540 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c2e9-60b8-476b-8145-2735bf3026c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:41.850343 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c2e9-60b8-476b-8145-2735bf3026c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:41.851020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551c2e9-60b8-476b-8145-2735bf3026c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:41.851322 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551c2e9-60b8-476b-8145-2735bf3026c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:41.853059 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551c2e9-60b8-476b-8145-2735bf3026c1 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:41.864982 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 454/900] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:41.871333 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cc665-f66e-48bc-9776-6c467377dbd9 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:41.898369 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:41.970127 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cc665-f66e-48bc-9776-6c467377dbd9 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:42.004081 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681ba69-082e-4410-93a3-0d6b0e208008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:42.004734 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681ba69-082e-4410-93a3-0d6b0e208008 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:42.005097 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681ba69-082e-4410-93a3-0d6b0e208008 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:42.005372 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681ba69-082e-4410-93a3-0d6b0e208008 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:42.012522 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681ba69-082e-4410-93a3-0d6b0e208008 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:42.013981 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681ba69-082e-4410-93a3-0d6b0e208008 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-7681ba69-082e-4410-93a3-0d6b0e208008 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 15:14:42.025248 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:42.026868 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:42.028026 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 447/901] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:42.035287 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551c2e9-60b8-476b-8145-2735bf3026c1 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:42.041956 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:42.136332 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551c2e9-60b8-476b-8145-2735bf3026c1 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:42.169357 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92580-bf0b-4722-9871-50df6b9a92b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:42.169897 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92580-bf0b-4722-9871-50df6b9a92b6 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:42.170176 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92580-bf0b-4722-9871-50df6b9a92b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:42.170447 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d92580-bf0b-4722-9871-50df6b9a92b6 None admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:42.171226 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92580-bf0b-4722-9871-50df6b9a92b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:42.171779 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92580-bf0b-4722-9871-50df6b9a92b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:42.173336 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d92580-bf0b-4722-9871-50df6b9a92b6 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:42.191140 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 455/902] 10.222.0.100 () {56 vars in 1148 bytes} [Tue Jul 26 15:14:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:42.199471 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681ba69-082e-4410-93a3-0d6b0e208008 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:42.282717 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:42.297362 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681ba69-082e-4410-93a3-0d6b0e208008 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:42.330283 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b355-8eab-4e1f-ba3c-5db694247b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:42.330884 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b355-8eab-4e1f-ba3c-5db694247b79 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:42.331166 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b355-8eab-4e1f-ba3c-5db694247b79 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:42.331445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2b355-8eab-4e1f-ba3c-5db694247b79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:42.397176 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2b355-8eab-4e1f-ba3c-5db694247b79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:42.398613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d2b355-8eab-4e1f-ba3c-5db694247b79 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:42.481464 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:42.497070 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 448/903] 10.222.0.100 () {58 vars in 1287 bytes} [Tue Jul 26 15:14:42 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 15:14:42.503181 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92580-bf0b-4722-9871-50df6b9a92b6 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:42.564940 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:42.603923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d92580-bf0b-4722-9871-50df6b9a92b6 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:42.637418 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac40f4-5b5a-4375-8e3e-cc3d0629ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:42.638061 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac40f4-5b5a-4375-8e3e-cc3d0629ea22 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:42.638348 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac40f4-5b5a-4375-8e3e-cc3d0629ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:42.638625 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac40f4-5b5a-4375-8e3e-cc3d0629ea22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:42.648976 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac40f4-5b5a-4375-8e3e-cc3d0629ea22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:42.650462 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac40f4-5b5a-4375-8e3e-cc3d0629ea22 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-f6ac40f4-5b5a-4375-8e3e-cc3d0629ea22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 15:14:42.665670 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:42.666748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:42.667735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 15:14:42.667735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 15:14:42.667735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 15:14:42.667735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:42.667735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 456/904] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:42.673812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b355-8eab-4e1f-ba3c-5db694247b79 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:42.770708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2b355-8eab-4e1f-ba3c-5db694247b79 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:42.804628 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4b8b8-2d40-4567-8a1e-d2cc796f15a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:42.805244 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4b8b8-2d40-4567-8a1e-d2cc796f15a5 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:42.805524 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4b8b8-2d40-4567-8a1e-d2cc796f15a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:42.805800 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4b8b8-2d40-4567-8a1e-d2cc796f15a5 None admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:42.806488 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4b8b8-2d40-4567-8a1e-d2cc796f15a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:42.806792 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4b8b8-2d40-4567-8a1e-d2cc796f15a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:42.808178 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4b8b8-2d40-4567-8a1e-d2cc796f15a5 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:42.819535 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 449/905] 10.222.0.100 () {56 vars in 1114 bytes} [Tue Jul 26 15:14:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:42.825313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac40f4-5b5a-4375-8e3e-cc3d0629ea22 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:42.926746 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac40f4-5b5a-4375-8e3e-cc3d0629ea22 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:42.940823 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:42.959885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb414b-e1aa-4dd2-a019-49b6480904a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:42.960553 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb414b-e1aa-4dd2-a019-49b6480904a7 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:42.960837 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb414b-e1aa-4dd2-a019-49b6480904a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:42.961113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb414b-e1aa-4dd2-a019-49b6480904a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:42.967600 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb414b-e1aa-4dd2-a019-49b6480904a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:42.969077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb414b-e1aa-4dd2-a019-49b6480904a7 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application [None req-57cb414b-e1aa-4dd2-a019-49b6480904a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 15:14:42.980557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:42.981617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:42.982826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 15:14:42.982826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 15:14:42.982826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 15:14:42.982826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 15:14:42.982826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 15:14:42.982826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 15:14:42.982826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 15:14:42.982826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: ERROR keystone.server.flask.application Jul 26 15:14:42.982826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 457/906] 10.222.0.100 () {56 vars in 1116 bytes} [Tue Jul 26 15:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:42.987710 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4b8b8-2d40-4567-8a1e-d2cc796f15a5 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:43.039679 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:43.092432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4b8b8-2d40-4567-8a1e-d2cc796f15a5 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:43.125702 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b3ddb-ed7d-4b7b-b1a5-0149fe1cb0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:43.126307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3ddb-ed7d-4b7b-b1a5-0149fe1cb0cf None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:43.126584 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3ddb-ed7d-4b7b-b1a5-0149fe1cb0cf None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:43.126852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b3ddb-ed7d-4b7b-b1a5-0149fe1cb0cf None admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:43.127585 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b3ddb-ed7d-4b7b-b1a5-0149fe1cb0cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:43.127886 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b3ddb-ed7d-4b7b-b1a5-0149fe1cb0cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:43.129331 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b3ddb-ed7d-4b7b-b1a5-0149fe1cb0cf None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:43.141050 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 450/907] 10.222.0.100 () {56 vars in 1153 bytes} [Tue Jul 26 15:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:43.147919 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb414b-e1aa-4dd2-a019-49b6480904a7 None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:43.246803 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb414b-e1aa-4dd2-a019-49b6480904a7 None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:43.279932 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca03e11-b8fd-476e-b270-cec603b4ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:43.280576 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca03e11-b8fd-476e-b270-cec603b4ec23 None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:43.280859 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca03e11-b8fd-476e-b270-cec603b4ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:43.281133 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca03e11-b8fd-476e-b270-cec603b4ec23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:43.281907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca03e11-b8fd-476e-b270-cec603b4ec23 None admin] RBAC: Adding query filter params (role.id=6d23401ca57e47398bf036ea320a7617, scope.project.id=7bc4375bb14d42199565b224bef1242c, user.id=1fdf1646dad14825b7f78ba823af840f) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:43.282216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca03e11-b8fd-476e-b270-cec603b4ec23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:43.283635 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca03e11-b8fd-476e-b270-cec603b4ec23 None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:43.290193 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 458/908] 10.222.0.100 () {56 vars in 1379 bytes} [Tue Jul 26 15:14:43 2022] GET /identity/v3/role_assignments?user.id=1fdf1646dad14825b7f78ba823af840f&scope.project.id=7bc4375bb14d42199565b224bef1242c&role.id=6d23401ca57e47398bf036ea320a7617 => generated 610 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:45.556605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb3d06-ee25-4bf6-8926-f2885dba6a33 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:45.557154 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb3d06-ee25-4bf6-8926-f2885dba6a33 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:45.557269 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb3d06-ee25-4bf6-8926-f2885dba6a33 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:45.558513 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 451/909] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:45.563787 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b67ba5-5e6d-42d5-961f-698f8fa0ada1 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:45.567144 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b67ba5-5e6d-42d5-961f-698f8fa0ada1 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:45.567144 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b67ba5-5e6d-42d5-961f-698f8fa0ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:45.582193 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-c1b67ba5-5e6d-42d5-961f-698f8fa0ada1 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:45.583384 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-c1b67ba5-5e6d-42d5-961f-698f8fa0ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:45.614021 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:45.652535 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 459/910] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:45 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:45.676776 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb3d06-ee25-4bf6-8926-f2885dba6a33 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:45.778582 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb3d06-ee25-4bf6-8926-f2885dba6a33 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:45.785578 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:45.810819 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bc32c-0977-47c7-9f40-2f21f4a126e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:45.811442 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc32c-0977-47c7-9f40-2f21f4a126e9 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:45.811719 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc32c-0977-47c7-9f40-2f21f4a126e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:45.811989 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bc32c-0977-47c7-9f40-2f21f4a126e9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:45.812629 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bc32c-0977-47c7-9f40-2f21f4a126e9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:45.814025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312bc32c-0977-47c7-9f40-2f21f4a126e9 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-312bc32c-0977-47c7-9f40-2f21f4a126e9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:45.822997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:45.825139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:45.826151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 452/911] 10.222.0.100 () {56 vars in 1122 bytes} [Tue Jul 26 15:14:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:45.830468 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b67ba5-5e6d-42d5-961f-698f8fa0ada1 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:45.932001 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b67ba5-5e6d-42d5-961f-698f8fa0ada1 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:45.966416 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed2fb0-0825-4d13-b339-fd65194eb5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:45.967027 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2fb0-0825-4d13-b339-fd65194eb5cb None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:45.967304 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2fb0-0825-4d13-b339-fd65194eb5cb None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:45.967577 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2fb0-0825-4d13-b339-fd65194eb5cb None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:45.968279 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed2fb0-0825-4d13-b339-fd65194eb5cb None admin] RBAC: Adding query filter params (name=placement) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:45.968580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed2fb0-0825-4d13-b339-fd65194eb5cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:45.969934 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed2fb0-0825-4d13-b339-fd65194eb5cb None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:45.974575 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 460/912] 10.222.0.100 () {56 vars in 1121 bytes} [Tue Jul 26 15:14:45 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:45.980443 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bc32c-0977-47c7-9f40-2f21f4a126e9 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:46.099402 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bc32c-0977-47c7-9f40-2f21f4a126e9 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:46.132584 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce70a29-0767-4afc-ad39-fdb86f416715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:46.133739 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce70a29-0767-4afc-ad39-fdb86f416715 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:46.134013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce70a29-0767-4afc-ad39-fdb86f416715 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:46.135470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce70a29-0767-4afc-ad39-fdb86f416715 None admin] PATH_INFO: `/v3/services` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:46.135470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce70a29-0767-4afc-ad39-fdb86f416715 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:46.135470 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce70a29-0767-4afc-ad39-fdb86f416715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:46.136752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce70a29-0767-4afc-ad39-fdb86f416715 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:46.141514 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 453/913] 10.222.0.100 () {56 vars in 1121 bytes} [Tue Jul 26 15:14:45 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:48.375884 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2a83f-f86e-4f71-af39-e5ba247f3d36 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:48.376449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2a83f-f86e-4f71-af39-e5ba247f3d36 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:48.376449 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2a83f-f86e-4f71-af39-e5ba247f3d36 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:48.377820 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 461/914] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:48.383080 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a787a09-3227-4fc2-bc81-9edd65eaa18e None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:48.383478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a787a09-3227-4fc2-bc81-9edd65eaa18e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:48.383634 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a787a09-3227-4fc2-bc81-9edd65eaa18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:48.402058 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-3a787a09-3227-4fc2-bc81-9edd65eaa18e None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:48.403235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-3a787a09-3227-4fc2-bc81-9edd65eaa18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:48.430084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:48.471342 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 454/915] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:48 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:48.495789 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2a83f-f86e-4f71-af39-e5ba247f3d36 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:48.541030 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:48.611066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2a83f-f86e-4f71-af39-e5ba247f3d36 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:48.649415 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb677c-f10b-4143-831c-aee7f1ce7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:48.649415 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb677c-f10b-4143-831c-aee7f1ce7e9e None admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:48.649415 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb677c-f10b-4143-831c-aee7f1ce7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:48.649415 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb677c-f10b-4143-831c-aee7f1ce7e9e None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:48.649828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb677c-f10b-4143-831c-aee7f1ce7e9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:48.649828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb677c-f10b-4143-831c-aee7f1ce7e9e None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:48.821259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 462/916] 10.222.0.100 () {60 vars in 1146 bytes} [Tue Jul 26 15:14:48 2022] POST /identity/v3/services => generated 247 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:14:51.063137 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e846-0785-4722-89ed-d92fd08ceab0 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:51.063778 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e846-0785-4722-89ed-d92fd08ceab0 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:51.063778 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e846-0785-4722-89ed-d92fd08ceab0 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:51.065136 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 455/917] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:51.070341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12026-889f-47e9-9b0b-8e68d91fd358 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:51.071296 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12026-889f-47e9-9b0b-8e68d91fd358 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:51.071426 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12026-889f-47e9-9b0b-8e68d91fd358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:51.090077 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-f2c12026-889f-47e9-9b0b-8e68d91fd358 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:51.091244 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f2c12026-889f-47e9-9b0b-8e68d91fd358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:51.163161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 463/918] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:51 2022] POST /identity/v3/auth/tokens => generated 1966 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:51.188301 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e846-0785-4722-89ed-d92fd08ceab0 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:51.318995 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e846-0785-4722-89ed-d92fd08ceab0 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:51.352646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22590231-1dcc-49ff-893e-61b7e4aab251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:51.353280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22590231-1dcc-49ff-893e-61b7e4aab251 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:51.353555 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22590231-1dcc-49ff-893e-61b7e4aab251 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:51.353829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22590231-1dcc-49ff-893e-61b7e4aab251 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:51.354472 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22590231-1dcc-49ff-893e-61b7e4aab251 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:51.355855 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22590231-1dcc-49ff-893e-61b7e4aab251 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-22590231-1dcc-49ff-893e-61b7e4aab251 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:51.364438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:51.365589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:51.366493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 456/919] 10.222.0.100 () {56 vars in 1122 bytes} [Tue Jul 26 15:14:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:51.371888 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12026-889f-47e9-9b0b-8e68d91fd358 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:51.390730 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:51.472693 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12026-889f-47e9-9b0b-8e68d91fd358 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:51.506177 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ef989-1aa4-4306-bb5e-e4d69e77f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:51.506795 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ef989-1aa4-4306-bb5e-e4d69e77f8eb None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:51.507080 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ef989-1aa4-4306-bb5e-e4d69e77f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:51.507360 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ef989-1aa4-4306-bb5e-e4d69e77f8eb None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:51.508060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ef989-1aa4-4306-bb5e-e4d69e77f8eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:51.508400 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ef989-1aa4-4306-bb5e-e4d69e77f8eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:51.509776 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ef989-1aa4-4306-bb5e-e4d69e77f8eb None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:51.514671 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 464/920] 10.222.0.100 () {56 vars in 1121 bytes} [Tue Jul 26 15:14:51 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:51.520818 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22590231-1dcc-49ff-893e-61b7e4aab251 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:51.569454 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:51.647010 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22590231-1dcc-49ff-893e-61b7e4aab251 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:51.680294 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6a571-2c00-446c-90e0-c7bd7a312d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:51.680951 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6a571-2c00-446c-90e0-c7bd7a312d5a None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:51.681234 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6a571-2c00-446c-90e0-c7bd7a312d5a None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:51.681511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6a571-2c00-446c-90e0-c7bd7a312d5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:51.682262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6a571-2c00-446c-90e0-c7bd7a312d5a None admin] RBAC: Adding query filter params (interface=public, service_id=5a9c5ed001cd4d8d9b3b33f66e5fd8ea, region_id=RegionOne) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:51.682573 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6a571-2c00-446c-90e0-c7bd7a312d5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:51.684009 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6a571-2c00-446c-90e0-c7bd7a312d5a None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:51.689530 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 457/921] 10.222.0.100 () {56 vars in 1256 bytes} [Tue Jul 26 15:14:51 2022] GET /identity/v3/endpoints?service_id=5a9c5ed001cd4d8d9b3b33f66e5fd8ea&interface=public®ion_id=RegionOne => generated 195 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:51.695472 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ef989-1aa4-4306-bb5e-e4d69e77f8eb None admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:51.777918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:51.796298 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ef989-1aa4-4306-bb5e-e4d69e77f8eb None admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:51.830775 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0c3d6-e3ab-43fd-be22-7ab4442c0f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:51.831368 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c3d6-e3ab-43fd-be22-7ab4442c0f8b None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:51.831622 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c3d6-e3ab-43fd-be22-7ab4442c0f8b None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:51.831980 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c3d6-e3ab-43fd-be22-7ab4442c0f8b None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:51.832596 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0c3d6-e3ab-43fd-be22-7ab4442c0f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:51.833937 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0c3d6-e3ab-43fd-be22-7ab4442c0f8b None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:51.841444 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 465/922] 10.222.0.100 () {56 vars in 1092 bytes} [Tue Jul 26 15:14:51 2022] GET /identity/v3/services => generated 1971 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:14:54.106979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4632c0-aee2-4382-ae13-45196ae7e6be None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:54.107582 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4632c0-aee2-4382-ae13-45196ae7e6be None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:54.107582 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4632c0-aee2-4382-ae13-45196ae7e6be None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:54.108906 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 458/923] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:14:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:14:54.114148 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4ab92-9007-4474-8d48-666974b3b8d2 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:54.115478 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4ab92-9007-4474-8d48-666974b3b8d2 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:54.115478 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4ab92-9007-4474-8d48-666974b3b8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:54.133361 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-f7d4ab92-9007-4474-8d48-666974b3b8d2 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:14:54.134524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f7d4ab92-9007-4474-8d48-666974b3b8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:14:54.201947 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 466/924] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:14:54 2022] POST /identity/v3/auth/tokens => generated 1966 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 15:14:54.225867 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4632c0-aee2-4382-ae13-45196ae7e6be None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:54.335877 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:54.349009 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4632c0-aee2-4382-ae13-45196ae7e6be None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:54.382302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083aee-bd98-4451-8b1f-9babd3084e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:54.382906 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083aee-bd98-4451-8b1f-9babd3084e56 None admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:54.383283 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083aee-bd98-4451-8b1f-9babd3084e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:54.383762 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083aee-bd98-4451-8b1f-9babd3084e56 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:54.384689 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98083aee-bd98-4451-8b1f-9babd3084e56 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:54.386942 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98083aee-bd98-4451-8b1f-9babd3084e56 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application [None req-98083aee-bd98-4451-8b1f-9babd3084e56 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 15:14:54.395509 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 15:14:54.396709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application with Lock( Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self._enter() Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application return self.creator() Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application created_value = creator( Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: ERROR keystone.server.flask.application Jul 26 15:14:54.397662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 459/925] 10.222.0.100 () {56 vars in 1122 bytes} [Tue Jul 26 15:14:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 15:14:54.402797 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4ab92-9007-4474-8d48-666974b3b8d2 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:54.478038 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:54.501561 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4ab92-9007-4474-8d48-666974b3b8d2 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:54.536170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23dc9e-b7f3-458c-a78c-a4f0b34bb91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:54.536782 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23dc9e-b7f3-458c-a78c-a4f0b34bb91d None admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:54.537063 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23dc9e-b7f3-458c-a78c-a4f0b34bb91d None admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:54.537337 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23dc9e-b7f3-458c-a78c-a4f0b34bb91d None admin] PATH_INFO: `/v3/services` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:54.538005 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23dc9e-b7f3-458c-a78c-a4f0b34bb91d None admin] RBAC: Adding query filter params (name=placement) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:14:54.538306 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23dc9e-b7f3-458c-a78c-a4f0b34bb91d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:54.540223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23dc9e-b7f3-458c-a78c-a4f0b34bb91d None admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:54.553228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 467/926] 10.222.0.100 () {56 vars in 1121 bytes} [Tue Jul 26 15:14:54 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:14:54.559169 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083aee-bd98-4451-8b1f-9babd3084e56 None admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:14:54.661582 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083aee-bd98-4451-8b1f-9babd3084e56 None admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:14:54.694175 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18eabf6-244f-4a00-9503-3c5c680e1e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:14:54.694782 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eabf6-244f-4a00-9503-3c5c680e1e30 None admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:14:54.695065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eabf6-244f-4a00-9503-3c5c680e1e30 None admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:14:54.695341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eabf6-244f-4a00-9503-3c5c680e1e30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:14:54.696616 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18eabf6-244f-4a00-9503-3c5c680e1e30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:14:54.697978 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18eabf6-244f-4a00-9503-3c5c680e1e30 None admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:14:54.773585 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 460/927] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:14:54 2022] POST /identity/v3/endpoints => generated 333 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:15:04.551903 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=30 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:04.769106 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:50.214098 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b8b7e-0410-41ad-a63f-00c1c043e8d1 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:50.214703 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b8b7e-0410-41ad-a63f-00c1c043e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:50.214703 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b8b7e-0410-41ad-a63f-00c1c043e8d1 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:50.216247 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 468/928] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:22:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:22:50.222150 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b73d53-b574-4aa1-a010-1656b6954ba6 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:50.222707 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b73d53-b574-4aa1-a010-1656b6954ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:50.222815 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b73d53-b574-4aa1-a010-1656b6954ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:50.358209 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-78b73d53-b574-4aa1-a010-1656b6954ba6 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:50.359728 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-78b73d53-b574-4aa1-a010-1656b6954ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:50.506646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 461/929] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:22:50 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:50.563878 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec2578-c62e-4ccd-b64e-459608341053 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:50.563878 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec2578-c62e-4ccd-b64e-459608341053 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:50.563878 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec2578-c62e-4ccd-b64e-459608341053 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:50.563878 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 469/930] 10.222.0.100 () {54 vars in 970 bytes} [Tue Jul 26 15:22:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:22:50.570304 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7bdee-c630-40fc-b665-62ce4ccf7456 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:50.570723 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7bdee-c630-40fc-b665-62ce4ccf7456 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:50.571123 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7bdee-c630-40fc-b665-62ce4ccf7456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:50.661854 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c5d7bdee-c630-40fc-b665-62ce4ccf7456 None None] MFA Rules not processed for user `50361b26fc1441ea9e78b3f59f1e4f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:50.663218 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c5d7bdee-c630-40fc-b665-62ce4ccf7456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:50.693413 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:50.740056 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 462/931] 10.222.0.100 () {58 vars in 1067 bytes} [Tue Jul 26 15:22:50 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:50.750544 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec2578-c62e-4ccd-b64e-459608341053 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:50.761998 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec2578-c62e-4ccd-b64e-459608341053 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:50.768095 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5f743-0367-45bc-8cad-145dcc1edf0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:50.768743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5f743-0367-45bc-8cad-145dcc1edf0b service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:50.769044 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5f743-0367-45bc-8cad-145dcc1edf0b service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:50.769304 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5f743-0367-45bc-8cad-145dcc1edf0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:50.779284 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5f743-0367-45bc-8cad-145dcc1edf0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:50.780741 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5f743-0367-45bc-8cad-145dcc1edf0b service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:50.790172 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 470/932] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:22:50 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:53.332487 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c9237-3ddc-48f7-97b2-4475d5f4d968 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.333030 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c9237-3ddc-48f7-97b2-4475d5f4d968 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.333030 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c9237-3ddc-48f7-97b2-4475d5f4d968 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.334359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 463/933] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:22:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:22:53.340050 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f022dd-be69-4d86-8d7f-551d1b1b33ce None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.340491 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f022dd-be69-4d86-8d7f-551d1b1b33ce None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.340634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f022dd-be69-4d86-8d7f-551d1b1b33ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.359899 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-d2f022dd-be69-4d86-8d7f-551d1b1b33ce None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:53.361207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-d2f022dd-be69-4d86-8d7f-551d1b1b33ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:53.369158 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 471/934] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:22:53 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:53.409200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c9237-3ddc-48f7-97b2-4475d5f4d968 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:53.419938 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c9237-3ddc-48f7-97b2-4475d5f4d968 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:53.423637 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdeb5a0-6336-4730-9849-76e0f7745189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:53.424275 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeb5a0-6336-4730-9849-76e0f7745189 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:53.424559 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeb5a0-6336-4730-9849-76e0f7745189 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:53.424834 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeb5a0-6336-4730-9849-76e0f7745189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:53.433791 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdeb5a0-6336-4730-9849-76e0f7745189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:53.435219 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdeb5a0-6336-4730-9849-76e0f7745189 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:53.445257 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 464/935] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:22:53 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:56.252654 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90b514-01d0-4a14-b0ea-acbf433bd840 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:56.253191 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90b514-01d0-4a14-b0ea-acbf433bd840 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:56.253191 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90b514-01d0-4a14-b0ea-acbf433bd840 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:56.254713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 472/936] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:22:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:22:56.260286 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a14827-266a-438f-8f9a-25cc1ad46237 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:56.260683 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a14827-266a-438f-8f9a-25cc1ad46237 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:56.260847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a14827-266a-438f-8f9a-25cc1ad46237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:56.320350 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-c5a14827-266a-438f-8f9a-25cc1ad46237 None None] MFA Rules not processed for user `165fb0c8ef88466bbeca4d331d0775f0`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:56.321640 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-c5a14827-266a-438f-8f9a-25cc1ad46237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:56.415655 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 465/937] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:22:56 2022] POST /identity/v3/auth/tokens => generated 2801 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:56.457023 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90b514-01d0-4a14-b0ea-acbf433bd840 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:56.468930 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90b514-01d0-4a14-b0ea-acbf433bd840 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:56.472959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c8210-3da7-439e-8680-c20393704368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:56.473650 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c8210-3da7-439e-8680-c20393704368 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:56.474008 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c8210-3da7-439e-8680-c20393704368 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:56.474356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c8210-3da7-439e-8680-c20393704368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:56.489976 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c8210-3da7-439e-8680-c20393704368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:56.491561 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c8210-3da7-439e-8680-c20393704368 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:56.502722 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 473/938] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:22:56 2022] GET /identity/v3/auth/tokens => generated 2801 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:22:59.632237 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7295e0-4696-460c-a83e-4b1e74cb0d7e None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:59.632755 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7295e0-4696-460c-a83e-4b1e74cb0d7e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:59.632844 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7295e0-4696-460c-a83e-4b1e74cb0d7e None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:59.634120 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 466/939] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:22:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:22:59.639303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a25a6-767b-4dc5-8f91-1fc7bc38fe93 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:59.639684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a25a6-767b-4dc5-8f91-1fc7bc38fe93 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:59.639866 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a25a6-767b-4dc5-8f91-1fc7bc38fe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:59.659362 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-a26a25a6-767b-4dc5-8f91-1fc7bc38fe93 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:59.660587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-a26a25a6-767b-4dc5-8f91-1fc7bc38fe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:59.730851 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 474/940] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:22:59 2022] POST /identity/v3/auth/tokens => generated 2796 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:59.787658 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58a33e-c0c0-4917-9f65-a0554538fd3e None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:59.788019 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58a33e-c0c0-4917-9f65-a0554538fd3e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:59.788805 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58a33e-c0c0-4917-9f65-a0554538fd3e None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:59.790177 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 467/941] 10.222.0.100 () {54 vars in 970 bytes} [Tue Jul 26 15:22:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:22:59.796015 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21b5ff-ea20-4aac-bb1b-783dcd0565e5 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:59.796341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21b5ff-ea20-4aac-bb1b-783dcd0565e5 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:59.796621 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21b5ff-ea20-4aac-bb1b-783dcd0565e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:59.815983 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-cd21b5ff-ea20-4aac-bb1b-783dcd0565e5 None None] MFA Rules not processed for user `50361b26fc1441ea9e78b3f59f1e4f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:22:59.817221 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-cd21b5ff-ea20-4aac-bb1b-783dcd0565e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:22:59.823592 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 475/942] 10.222.0.100 () {58 vars in 1067 bytes} [Tue Jul 26 15:22:59 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:22:59.832369 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58a33e-c0c0-4917-9f65-a0554538fd3e None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:22:59.843353 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58a33e-c0c0-4917-9f65-a0554538fd3e None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:22:59.846810 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02046dff-bb80-48fa-8e2c-bedf013403cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:22:59.847408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02046dff-bb80-48fa-8e2c-bedf013403cb service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:22:59.847692 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02046dff-bb80-48fa-8e2c-bedf013403cb service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:22:59.847970 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02046dff-bb80-48fa-8e2c-bedf013403cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:22:59.857287 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02046dff-bb80-48fa-8e2c-bedf013403cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:22:59.858789 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02046dff-bb80-48fa-8e2c-bedf013403cb service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:22:59.868361 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 468/943] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:22:59 2022] GET /identity/v3/auth/tokens => generated 2796 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:03.599150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4a7a-c9d4-4a57-8c07-3bed4c44d23d None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:03.599743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4a7a-c9d4-4a57-8c07-3bed4c44d23d None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:03.599743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4a7a-c9d4-4a57-8c07-3bed4c44d23d None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:03.601659 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 476/944] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:03.606935 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0ab6-c343-417b-ade3-fe853de66b1d None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:03.607393 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0ab6-c343-417b-ade3-fe853de66b1d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:03.607493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f0ab6-c343-417b-ade3-fe853de66b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:03.629065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-830f0ab6-c343-417b-ade3-fe853de66b1d None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:03.630263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-830f0ab6-c343-417b-ade3-fe853de66b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:03.638125 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 469/945] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:03 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:03.676155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d4a7a-c9d4-4a57-8c07-3bed4c44d23d None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:03.686713 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d4a7a-c9d4-4a57-8c07-3bed4c44d23d None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:03.690474 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb6b1f-d77d-4c9e-8384-3ec17c592b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:03.691083 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb6b1f-d77d-4c9e-8384-3ec17c592b80 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:03.691369 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb6b1f-d77d-4c9e-8384-3ec17c592b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:03.691646 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb6b1f-d77d-4c9e-8384-3ec17c592b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:03.701567 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb6b1f-d77d-4c9e-8384-3ec17c592b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:03.703012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb6b1f-d77d-4c9e-8384-3ec17c592b80 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:03.713748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 477/946] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:03 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:06.025539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa985c-447d-46f3-b699-38b14d122972 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:06.026168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa985c-447d-46f3-b699-38b14d122972 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:06.026168 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa985c-447d-46f3-b699-38b14d122972 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:06.027327 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 470/947] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:06.032847 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c971beb-6159-44ce-9154-0d8506d9c5f6 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:06.033274 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c971beb-6159-44ce-9154-0d8506d9c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:06.033389 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c971beb-6159-44ce-9154-0d8506d9c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:06.055044 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-0c971beb-6159-44ce-9154-0d8506d9c5f6 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:06.056306 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-0c971beb-6159-44ce-9154-0d8506d9c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:06.064342 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 478/948] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:06 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:06.101584 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa985c-447d-46f3-b699-38b14d122972 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:06.112077 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa985c-447d-46f3-b699-38b14d122972 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:06.116198 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329b697-17e1-4bbf-9ae2-c437d95a6f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:06.116859 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329b697-17e1-4bbf-9ae2-c437d95a6f72 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:06.117203 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329b697-17e1-4bbf-9ae2-c437d95a6f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:06.117539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329b697-17e1-4bbf-9ae2-c437d95a6f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:06.126825 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329b697-17e1-4bbf-9ae2-c437d95a6f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:06.128273 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329b697-17e1-4bbf-9ae2-c437d95a6f72 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:06.138951 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 471/949] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:06 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:08.467549 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53592-6dbe-4b08-a4e7-0ea8a7f6a652 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:08.468102 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53592-6dbe-4b08-a4e7-0ea8a7f6a652 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:08.468252 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53592-6dbe-4b08-a4e7-0ea8a7f6a652 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:08.469745 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 479/950] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:08.476406 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e7639-3e01-439e-9910-5aeef50c661f None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:08.476964 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e7639-3e01-439e-9910-5aeef50c661f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:08.476964 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e7639-3e01-439e-9910-5aeef50c661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:08.497544 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-168e7639-3e01-439e-9910-5aeef50c661f None None] MFA Rules not processed for user `165fb0c8ef88466bbeca4d331d0775f0`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:08.498744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-168e7639-3e01-439e-9910-5aeef50c661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:08.506755 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 472/951] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:08 2022] POST /identity/v3/auth/tokens => generated 2801 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:08.545391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee53592-6dbe-4b08-a4e7-0ea8a7f6a652 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:08.556886 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee53592-6dbe-4b08-a4e7-0ea8a7f6a652 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:08.560406 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf10b3-aced-4e3c-a4e2-6556fa93ca5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:08.561008 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf10b3-aced-4e3c-a4e2-6556fa93ca5c service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:08.561289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf10b3-aced-4e3c-a4e2-6556fa93ca5c service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:08.561564 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf10b3-aced-4e3c-a4e2-6556fa93ca5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:08.570352 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf10b3-aced-4e3c-a4e2-6556fa93ca5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:08.571788 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf10b3-aced-4e3c-a4e2-6556fa93ca5c service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:08.581423 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 480/952] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:08 2022] GET /identity/v3/auth/tokens => generated 2801 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:11.395405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef146-a465-40be-997f-4c0339344733 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:11.395951 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef146-a465-40be-997f-4c0339344733 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:11.395951 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef146-a465-40be-997f-4c0339344733 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:11.398095 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 473/953] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:11.403571 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537a679-6d05-4b3b-88bc-c09e645dcd08 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:11.404627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537a679-6d05-4b3b-88bc-c09e645dcd08 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:11.404627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537a679-6d05-4b3b-88bc-c09e645dcd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:11.423245 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-f537a679-6d05-4b3b-88bc-c09e645dcd08 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:11.427153 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f537a679-6d05-4b3b-88bc-c09e645dcd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:11.432991 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 481/954] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:11 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:11.470632 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ef146-a465-40be-997f-4c0339344733 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:11.481494 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ef146-a465-40be-997f-4c0339344733 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:11.485129 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae4fdd-8dca-4b6f-8038-d20beb30726b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:11.485774 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4fdd-8dca-4b6f-8038-d20beb30726b service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:11.486053 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4fdd-8dca-4b6f-8038-d20beb30726b service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:11.486325 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae4fdd-8dca-4b6f-8038-d20beb30726b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:11.495726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae4fdd-8dca-4b6f-8038-d20beb30726b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:11.497197 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae4fdd-8dca-4b6f-8038-d20beb30726b service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:11.501100 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:11.507500 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 474/955] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:11 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:13.855073 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f037a1-863b-4af4-91d9-bddaa3db14fc None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:13.855650 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f037a1-863b-4af4-91d9-bddaa3db14fc None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:13.855774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f037a1-863b-4af4-91d9-bddaa3db14fc None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:13.857143 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 482/956] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:13.862411 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5480b3-31ed-45ac-97dc-2248057d5b58 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:13.862830 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5480b3-31ed-45ac-97dc-2248057d5b58 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:13.862973 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5480b3-31ed-45ac-97dc-2248057d5b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:13.881855 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-5a5480b3-31ed-45ac-97dc-2248057d5b58 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:13.883034 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-5a5480b3-31ed-45ac-97dc-2248057d5b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:13.890885 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 475/957] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:13 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:13.932971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f037a1-863b-4af4-91d9-bddaa3db14fc None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:13.945302 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f037a1-863b-4af4-91d9-bddaa3db14fc None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:13.948902 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ed0e3-97e4-4f3e-a297-d2df6ca849cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:13.950066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed0e3-97e4-4f3e-a297-d2df6ca849cc service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:13.950066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed0e3-97e4-4f3e-a297-d2df6ca849cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:13.950224 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed0e3-97e4-4f3e-a297-d2df6ca849cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:13.960712 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ed0e3-97e4-4f3e-a297-d2df6ca849cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:13.962227 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ed0e3-97e4-4f3e-a297-d2df6ca849cc service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:13.972666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 483/958] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:13 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:16.938399 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2e55-86fb-481c-b3e2-2a6aba0e9a97 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:16.938925 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2e55-86fb-481c-b3e2-2a6aba0e9a97 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:16.938925 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2e55-86fb-481c-b3e2-2a6aba0e9a97 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:16.940202 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 476/959] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:16.945880 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d574a7d-bc7a-46b9-b279-7727ed8e2247 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:16.946258 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d574a7d-bc7a-46b9-b279-7727ed8e2247 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:16.946435 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d574a7d-bc7a-46b9-b279-7727ed8e2247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:16.953868 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=74 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:16.965302 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-8d574a7d-bc7a-46b9-b279-7727ed8e2247 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:16.966489 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-8d574a7d-bc7a-46b9-b279-7727ed8e2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:16.974684 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 484/960] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:16 2022] POST /identity/v3/auth/tokens => generated 2796 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:23:17.012676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b2e55-86fb-481c-b3e2-2a6aba0e9a97 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:17.023216 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b2e55-86fb-481c-b3e2-2a6aba0e9a97 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:17.027031 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b908d34-8014-406f-84e7-2203276f8f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:17.027625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b908d34-8014-406f-84e7-2203276f8f91 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:17.027906 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b908d34-8014-406f-84e7-2203276f8f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:17.028214 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b908d34-8014-406f-84e7-2203276f8f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:17.036918 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b908d34-8014-406f-84e7-2203276f8f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:17.038339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b908d34-8014-406f-84e7-2203276f8f91 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:17.047526 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 477/961] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:17 2022] GET /identity/v3/auth/tokens => generated 2796 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:21.574242 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df0c47-cd0a-40d6-9c54-e692bdfe6edd None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:21.574779 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df0c47-cd0a-40d6-9c54-e692bdfe6edd None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:21.574779 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df0c47-cd0a-40d6-9c54-e692bdfe6edd None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:21.576450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 485/962] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:23:21.581810 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaedd6-d0b8-4208-8901-454cbb5516ab None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:21.582258 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaedd6-d0b8-4208-8901-454cbb5516ab None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:21.582357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feaedd6-d0b8-4208-8901-454cbb5516ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:21.602267 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-5feaedd6-d0b8-4208-8901-454cbb5516ab None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:21.603472 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-5feaedd6-d0b8-4208-8901-454cbb5516ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:21.611586 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 478/963] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:21 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:23:21.652683 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df0c47-cd0a-40d6-9c54-e692bdfe6edd None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:21.663965 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df0c47-cd0a-40d6-9c54-e692bdfe6edd None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:21.667586 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5375ef-1231-486a-9a2b-33e3145818dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:21.669205 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5375ef-1231-486a-9a2b-33e3145818dc service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:21.669561 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5375ef-1231-486a-9a2b-33e3145818dc service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:21.669905 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5375ef-1231-486a-9a2b-33e3145818dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:21.679941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5375ef-1231-486a-9a2b-33e3145818dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:21.681399 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5375ef-1231-486a-9a2b-33e3145818dc service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:21.690948 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 486/964] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:21 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:25.063684 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da0081-b73a-4d68-a92d-d57abe0b61bb None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:25.064521 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da0081-b73a-4d68-a92d-d57abe0b61bb None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:25.064521 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da0081-b73a-4d68-a92d-d57abe0b61bb None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:25.067520 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 479/965] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:25 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:25.073909 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aa0b3-4b7c-4b02-b855-230de22f6c91 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:25.074369 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aa0b3-4b7c-4b02-b855-230de22f6c91 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:25.074447 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aa0b3-4b7c-4b02-b855-230de22f6c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:25.096877 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-b90aa0b3-4b7c-4b02-b855-230de22f6c91 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:25.110324 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-b90aa0b3-4b7c-4b02-b855-230de22f6c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:25.110324 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 487/966] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:25 2022] POST /identity/v3/auth/tokens => generated 2796 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:25.146135 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da0081-b73a-4d68-a92d-d57abe0b61bb None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:25.157191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da0081-b73a-4d68-a92d-d57abe0b61bb None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:25.160756 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552ce13-3b75-4e59-8d39-0eb6b9fbed80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:25.161359 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552ce13-3b75-4e59-8d39-0eb6b9fbed80 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:25.161641 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552ce13-3b75-4e59-8d39-0eb6b9fbed80 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:25.161917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552ce13-3b75-4e59-8d39-0eb6b9fbed80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:25.171399 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552ce13-3b75-4e59-8d39-0eb6b9fbed80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:25.172873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552ce13-3b75-4e59-8d39-0eb6b9fbed80 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:25.182832 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 480/967] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:25 2022] GET /identity/v3/auth/tokens => generated 2796 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:29.885215 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278af37d-2d46-473a-b1b7-82a83d3feac7 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:29.885791 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278af37d-2d46-473a-b1b7-82a83d3feac7 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:29.885791 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278af37d-2d46-473a-b1b7-82a83d3feac7 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:29.887122 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 488/968] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:29.892689 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7bea7-6ab3-4081-88c0-f8663854b36b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:29.893393 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7bea7-6ab3-4081-88c0-f8663854b36b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:29.893632 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7bea7-6ab3-4081-88c0-f8663854b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:29.915947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-fdf7bea7-6ab3-4081-88c0-f8663854b36b None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:29.917395 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-fdf7bea7-6ab3-4081-88c0-f8663854b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:29.926353 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 481/969] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:29 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:23:29.967513 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278af37d-2d46-473a-b1b7-82a83d3feac7 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:29.978432 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278af37d-2d46-473a-b1b7-82a83d3feac7 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:29.981988 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6b3b1-c691-4074-a03b-67d815ee2571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:29.982588 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b3b1-c691-4074-a03b-67d815ee2571 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:29.982869 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b3b1-c691-4074-a03b-67d815ee2571 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:29.983146 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b3b1-c691-4074-a03b-67d815ee2571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:29.991941 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6b3b1-c691-4074-a03b-67d815ee2571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:29.993391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6b3b1-c691-4074-a03b-67d815ee2571 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:30.002841 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 489/970] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:29 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:35.425700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc4ce-ba95-4b9a-92be-c9177405c499 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:35.426577 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc4ce-ba95-4b9a-92be-c9177405c499 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:35.427014 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc4ce-ba95-4b9a-92be-c9177405c499 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:35.432989 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 482/971] 10.222.0.100 () {54 vars in 926 bytes} [Tue Jul 26 15:23:35 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:35.442122 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c08086-38c0-4d95-a5fa-4ce471d8a282 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:35.452473 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c08086-38c0-4d95-a5fa-4ce471d8a282 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:35.452473 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c08086-38c0-4d95-a5fa-4ce471d8a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:35.493203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-54c08086-38c0-4d95-a5fa-4ce471d8a282 None None] MFA Rules not processed for user `1fdf1646dad14825b7f78ba823af840f`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:35.494413 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-54c08086-38c0-4d95-a5fa-4ce471d8a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:35.580519 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 490/972] 10.222.0.100 () {58 vars in 1023 bytes} [Tue Jul 26 15:23:35 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:39.909560 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=22 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:40.155604 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15128-768e-4bfe-8d9b-cbe2d5202727 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:40.156036 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15128-768e-4bfe-8d9b-cbe2d5202727 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:40.156434 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec15128-768e-4bfe-8d9b-cbe2d5202727 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:40.158294 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 483/973] 10.222.0.100 () {54 vars in 926 bytes} [Tue Jul 26 15:23:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:40.164075 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94cf6-5571-4b67-b542-7d870012fa65 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:40.164676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94cf6-5571-4b67-b542-7d870012fa65 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:40.165162 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d94cf6-5571-4b67-b542-7d870012fa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:40.185368 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-f3d94cf6-5571-4b67-b542-7d870012fa65 None None] MFA Rules not processed for user `1fdf1646dad14825b7f78ba823af840f`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:40.186734 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f3d94cf6-5571-4b67-b542-7d870012fa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:40.195673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 491/974] 10.222.0.100 () {58 vars in 1023 bytes} [Tue Jul 26 15:23:40 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:41.740077 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950f3ed-71f5-40d1-ba1c-254592f102d3 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:41.740616 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950f3ed-71f5-40d1-ba1c-254592f102d3 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:41.740616 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950f3ed-71f5-40d1-ba1c-254592f102d3 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:41.741961 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 484/975] 10.222.0.100 () {54 vars in 926 bytes} [Tue Jul 26 15:23:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:41.747245 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a2557-e33a-421c-a91a-6519310bb5e9 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:41.747711 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a2557-e33a-421c-a91a-6519310bb5e9 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:41.747834 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a2557-e33a-421c-a91a-6519310bb5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:41.768203 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-d65a2557-e33a-421c-a91a-6519310bb5e9 None None] MFA Rules not processed for user `1fdf1646dad14825b7f78ba823af840f`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:41.769413 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-d65a2557-e33a-421c-a91a-6519310bb5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:41.779068 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 492/976] 10.222.0.100 () {58 vars in 1023 bytes} [Tue Jul 26 15:23:41 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:45.812608 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe4b25-17cd-4705-953b-fa343e8dbed2 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:45.813141 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe4b25-17cd-4705-953b-fa343e8dbed2 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:45.813141 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe4b25-17cd-4705-953b-fa343e8dbed2 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:45.814521 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 485/977] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:45.819619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609d0e6-4984-4746-9534-73a57c4042a2 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:45.820072 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609d0e6-4984-4746-9534-73a57c4042a2 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:45.820217 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609d0e6-4984-4746-9534-73a57c4042a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:45.840816 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-6609d0e6-4984-4746-9534-73a57c4042a2 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:45.842591 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-6609d0e6-4984-4746-9534-73a57c4042a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:45.852724 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 493/978] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:45 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:45.912593 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180559-b4cd-4e76-8f34-63dfd8f344b1 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:45.912593 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180559-b4cd-4e76-8f34-63dfd8f344b1 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:45.912593 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180559-b4cd-4e76-8f34-63dfd8f344b1 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:45.912593 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 486/979] 10.222.0.100 () {54 vars in 967 bytes} [Tue Jul 26 15:23:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:45.921153 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088392-8322-4770-a4a9-6425acef8fc0 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:45.921885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088392-8322-4770-a4a9-6425acef8fc0 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:45.922392 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088392-8322-4770-a4a9-6425acef8fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:45.987939 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-24088392-8322-4770-a4a9-6425acef8fc0 None None] MFA Rules not processed for user `dcc3cee241bd45c49e37124cc4dd6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:45.989368 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-24088392-8322-4770-a4a9-6425acef8fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:46.043170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:46.071664 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 494/980] 10.222.0.100 () {58 vars in 1064 bytes} [Tue Jul 26 15:23:45 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:23:46.079316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180559-b4cd-4e76-8f34-63dfd8f344b1 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:46.094354 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d180559-b4cd-4e76-8f34-63dfd8f344b1 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:46.099428 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2c0ce-4de9-4bc8-bd25-0741385c0554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:46.100742 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2c0ce-4de9-4bc8-bd25-0741385c0554 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:46.101138 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2c0ce-4de9-4bc8-bd25-0741385c0554 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:46.101478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2c0ce-4de9-4bc8-bd25-0741385c0554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:46.111083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2c0ce-4de9-4bc8-bd25-0741385c0554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:46.112688 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2c0ce-4de9-4bc8-bd25-0741385c0554 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:46.124084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 487/981] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:46 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:48.601637 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a5e8-3fd4-48dc-b50a-b3d2d1285919 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:48.602164 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a5e8-3fd4-48dc-b50a-b3d2d1285919 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:48.602164 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0a5e8-3fd4-48dc-b50a-b3d2d1285919 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:48.603674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 495/982] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:48.609002 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5efe-03df-4c02-bd82-12ac43602107 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:48.609435 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5efe-03df-4c02-bd82-12ac43602107 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:48.609536 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d5efe-03df-4c02-bd82-12ac43602107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:48.629725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-0a0d5efe-03df-4c02-bd82-12ac43602107 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:48.631551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-0a0d5efe-03df-4c02-bd82-12ac43602107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:48.639982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 488/983] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:48 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:48.685902 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a5e8-3fd4-48dc-b50a-b3d2d1285919 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:48.700364 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0a5e8-3fd4-48dc-b50a-b3d2d1285919 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:48.705750 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ab98b-d20f-49a7-b372-7d59498fe59d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:48.706456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ab98b-d20f-49a7-b372-7d59498fe59d service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:48.706816 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ab98b-d20f-49a7-b372-7d59498fe59d service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:48.707168 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ab98b-d20f-49a7-b372-7d59498fe59d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:48.716366 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ab98b-d20f-49a7-b372-7d59498fe59d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:48.718058 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ab98b-d20f-49a7-b372-7d59498fe59d service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:48.730318 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 496/984] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:48 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:51.463416 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401b45-2041-468c-be6e-154ca0bf8969 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:51.463959 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401b45-2041-468c-be6e-154ca0bf8969 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:51.463959 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c401b45-2041-468c-be6e-154ca0bf8969 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:51.465332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 489/985] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:51.470705 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741300e-77cd-4221-bf45-13fee32fc716 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:51.471130 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741300e-77cd-4221-bf45-13fee32fc716 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:51.471330 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741300e-77cd-4221-bf45-13fee32fc716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:51.492753 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-7741300e-77cd-4221-bf45-13fee32fc716 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:51.494201 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-7741300e-77cd-4221-bf45-13fee32fc716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:51.502885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 497/986] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:51 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:51.555423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95d49c-eaff-4d71-822b-9e417d792f17 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:51.555707 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95d49c-eaff-4d71-822b-9e417d792f17 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:51.555985 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95d49c-eaff-4d71-822b-9e417d792f17 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:51.557663 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 490/987] 10.222.0.100 () {54 vars in 967 bytes} [Tue Jul 26 15:23:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:51.565658 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba54df-3962-45ac-b6b7-c81f5dddfcde None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:51.565948 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba54df-3962-45ac-b6b7-c81f5dddfcde None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:51.566229 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba54df-3962-45ac-b6b7-c81f5dddfcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:51.596474 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-1bba54df-3962-45ac-b6b7-c81f5dddfcde None None] MFA Rules not processed for user `dcc3cee241bd45c49e37124cc4dd6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:51.597691 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-1bba54df-3962-45ac-b6b7-c81f5dddfcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:51.613493 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 498/988] 10.222.0.100 () {58 vars in 1064 bytes} [Tue Jul 26 15:23:51 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:51.626147 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95d49c-eaff-4d71-822b-9e417d792f17 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:51.641231 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95d49c-eaff-4d71-822b-9e417d792f17 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:51.646991 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea9bd0-bb8f-4634-b451-96eed336e54b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:51.647598 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea9bd0-bb8f-4634-b451-96eed336e54b service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:51.647880 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea9bd0-bb8f-4634-b451-96eed336e54b service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:51.648187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea9bd0-bb8f-4634-b451-96eed336e54b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:51.657243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea9bd0-bb8f-4634-b451-96eed336e54b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:51.658836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea9bd0-bb8f-4634-b451-96eed336e54b service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:51.668808 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 491/989] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:51 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:23:54.237458 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d5df-ad18-42b9-b336-7c53d905f62c None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:54.238347 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d5df-ad18-42b9-b336-7c53d905f62c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:54.238848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d5df-ad18-42b9-b336-7c53d905f62c None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:54.246763 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368d2a6-6315-4b6c-8374-bcf79c3e4057 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:54.247566 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368d2a6-6315-4b6c-8374-bcf79c3e4057 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:54.247995 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368d2a6-6315-4b6c-8374-bcf79c3e4057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:54.250938 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 499/990] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:54 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:54.276750 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-4368d2a6-6315-4b6c-8374-bcf79c3e4057 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:54.279229 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-4368d2a6-6315-4b6c-8374-bcf79c3e4057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:54.295775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 492/991] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:54 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:54.335407 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123d5df-ad18-42b9-b336-7c53d905f62c None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:54.350314 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123d5df-ad18-42b9-b336-7c53d905f62c None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:54.356202 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d834328-7397-482f-aee6-21532d3636e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:54.356987 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d834328-7397-482f-aee6-21532d3636e1 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:54.357425 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d834328-7397-482f-aee6-21532d3636e1 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:54.357884 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d834328-7397-482f-aee6-21532d3636e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:54.367935 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d834328-7397-482f-aee6-21532d3636e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:54.370020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d834328-7397-482f-aee6-21532d3636e1 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:54.381612 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 500/992] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:54 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:56.149563 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec2631-9e4b-4614-b400-4d7bd96fa7c7 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:56.150002 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec2631-9e4b-4614-b400-4d7bd96fa7c7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:56.150187 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec2631-9e4b-4614-b400-4d7bd96fa7c7 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:56.151769 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 493/993] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:56.156863 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc582525-7a3d-490e-9cce-cf160cdd4ffd None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:56.157958 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc582525-7a3d-490e-9cce-cf160cdd4ffd None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:56.158633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc582525-7a3d-490e-9cce-cf160cdd4ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:56.191313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-fc582525-7a3d-490e-9cce-cf160cdd4ffd None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:56.193434 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-fc582525-7a3d-490e-9cce-cf160cdd4ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:56.212908 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 501/994] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:56 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:56.548538 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d0a0-5aea-4c53-9d7e-469d22d50959 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:56.548940 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d0a0-5aea-4c53-9d7e-469d22d50959 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:56.549329 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d0a0-5aea-4c53-9d7e-469d22d50959 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:56.550912 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 494/995] 10.222.0.100 () {54 vars in 969 bytes} [Tue Jul 26 15:23:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:56.556374 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5789-c50b-428f-9347-b3870ed64041 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:56.556767 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5789-c50b-428f-9347-b3870ed64041 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:56.557152 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5789-c50b-428f-9347-b3870ed64041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:56.608149 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-491f5789-c50b-428f-9347-b3870ed64041 None None] MFA Rules not processed for user `c5e22a12ebdd493c8c14cfaf2dfc1af2`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:56.609661 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-491f5789-c50b-428f-9347-b3870ed64041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:56.674154 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 502/996] 10.222.0.100 () {58 vars in 1066 bytes} [Tue Jul 26 15:23:56 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:56.682119 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433d0a0-5aea-4c53-9d7e-469d22d50959 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:56.697452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433d0a0-5aea-4c53-9d7e-469d22d50959 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:56.704980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afe5c0-5987-423d-b5f6-504ab14c69c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5e22a12ebdd493c8c14cfaf2dfc1af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:56.706060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afe5c0-5987-423d-b5f6-504ab14c69c0 service cinder] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:56.706566 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afe5c0-5987-423d-b5f6-504ab14c69c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:56.707075 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afe5c0-5987-423d-b5f6-504ab14c69c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:56.730981 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afe5c0-5987-423d-b5f6-504ab14c69c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:56.732492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afe5c0-5987-423d-b5f6-504ab14c69c0 service cinder] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:56.743865 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 495/997] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:56 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:23:57.202476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446aa5d-8f3c-4121-9d0f-73554cc573e8 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:57.203056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446aa5d-8f3c-4121-9d0f-73554cc573e8 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:57.203056 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446aa5d-8f3c-4121-9d0f-73554cc573e8 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:57.204441 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 503/998] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:57.209910 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93bbf4-f894-41f6-bce3-98d1d5e79249 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:57.210678 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93bbf4-f894-41f6-bce3-98d1d5e79249 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:57.211134 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93bbf4-f894-41f6-bce3-98d1d5e79249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:57.230862 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-5b93bbf4-f894-41f6-bce3-98d1d5e79249 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:57.232052 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-5b93bbf4-f894-41f6-bce3-98d1d5e79249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:57.240994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 496/999] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:57 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:57.285883 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446aa5d-8f3c-4121-9d0f-73554cc573e8 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:57.300532 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446aa5d-8f3c-4121-9d0f-73554cc573e8 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:57.307039 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f7b38-79c0-4e10-9715-d2a6fb287a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:57.307849 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f7b38-79c0-4e10-9715-d2a6fb287a38 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:57.308416 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f7b38-79c0-4e10-9715-d2a6fb287a38 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:57.308767 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f7b38-79c0-4e10-9715-d2a6fb287a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:57.320460 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f7b38-79c0-4e10-9715-d2a6fb287a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:57.322211 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f7b38-79c0-4e10-9715-d2a6fb287a38 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:23:57.332615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 504/1000] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:57 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:23:59.864458 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe87345-676b-461e-bf33-24a7a1cc6301 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:59.864976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe87345-676b-461e-bf33-24a7a1cc6301 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:59.865370 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe87345-676b-461e-bf33-24a7a1cc6301 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:59.866777 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 497/1001] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:23:59 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:23:59.872483 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e171bb-1859-4c89-9d08-b2b15ed1a000 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:59.872909 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e171bb-1859-4c89-9d08-b2b15ed1a000 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:59.873178 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e171bb-1859-4c89-9d08-b2b15ed1a000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:59.906533 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-27e171bb-1859-4c89-9d08-b2b15ed1a000 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:23:59.907837 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-27e171bb-1859-4c89-9d08-b2b15ed1a000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:23:59.916456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 505/1002] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:23:59 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:23:59.961450 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe87345-676b-461e-bf33-24a7a1cc6301 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:23:59.975621 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe87345-676b-461e-bf33-24a7a1cc6301 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:23:59.983473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bad142-b0c5-4c3b-affd-7b7683a05357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:23:59.984229 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad142-b0c5-4c3b-affd-7b7683a05357 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:23:59.984405 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad142-b0c5-4c3b-affd-7b7683a05357 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:23:59.984682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bad142-b0c5-4c3b-affd-7b7683a05357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:23:59.994694 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bad142-b0c5-4c3b-affd-7b7683a05357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:23:59.996329 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bad142-b0c5-4c3b-affd-7b7683a05357 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:00.006341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 498/1003] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:23:59 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:02.411813 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e16e-dc54-4b7d-ae7d-264813b52f20 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:02.412378 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e16e-dc54-4b7d-ae7d-264813b52f20 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:02.412378 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e16e-dc54-4b7d-ae7d-264813b52f20 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:02.413727 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 506/1004] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:24:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:02.418945 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe934c5-27f8-4c85-a542-f6739c77a7ef None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:02.419364 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe934c5-27f8-4c85-a542-f6739c77a7ef None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:02.419498 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe934c5-27f8-4c85-a542-f6739c77a7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:02.438865 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-bbe934c5-27f8-4c85-a542-f6739c77a7ef None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:02.440045 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-bbe934c5-27f8-4c85-a542-f6739c77a7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:02.448614 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 499/1005] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:24:02 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:02.493188 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e16e-dc54-4b7d-ae7d-264813b52f20 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:02.507752 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e16e-dc54-4b7d-ae7d-264813b52f20 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:02.513140 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c8a1-0cc9-4dcb-82c9-4926129c272d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:02.513759 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c8a1-0cc9-4dcb-82c9-4926129c272d service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:02.514041 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c8a1-0cc9-4dcb-82c9-4926129c272d service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:02.514319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c8a1-0cc9-4dcb-82c9-4926129c272d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:02.524164 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c8a1-0cc9-4dcb-82c9-4926129c272d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:02.525867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c8a1-0cc9-4dcb-82c9-4926129c272d service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:02.535906 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 507/1006] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:02 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:04.792846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7f87-3092-47de-a863-53ccf8a5d856 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.793423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7f87-3092-47de-a863-53ccf8a5d856 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.793423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c7f87-3092-47de-a863-53ccf8a5d856 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:04.794919 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 500/1007] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:24:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:04.799954 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31509f-eecf-4445-a076-9dbd0898f034 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.800430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31509f-eecf-4445-a076-9dbd0898f034 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.800542 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31509f-eecf-4445-a076-9dbd0898f034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:04.820937 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-8a31509f-eecf-4445-a076-9dbd0898f034 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:04.823554 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-8a31509f-eecf-4445-a076-9dbd0898f034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:04.831384 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 508/1008] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:24:04 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:04.877122 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c7f87-3092-47de-a863-53ccf8a5d856 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:04.892424 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c7f87-3092-47de-a863-53ccf8a5d856 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:04.897487 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bea9e-7732-4ff9-adc7-8750ebb8d0ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:04.898099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bea9e-7732-4ff9-adc7-8750ebb8d0ea service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:04.898384 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bea9e-7732-4ff9-adc7-8750ebb8d0ea service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:04.898662 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bea9e-7732-4ff9-adc7-8750ebb8d0ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:04.907676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bea9e-7732-4ff9-adc7-8750ebb8d0ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:04.909396 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bea9e-7732-4ff9-adc7-8750ebb8d0ea service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:04.919427 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 501/1009] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:04 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:07.404356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31aabf-49c0-46c4-9f4a-ae3eadea31c6 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:07.478050 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31aabf-49c0-46c4-9f4a-ae3eadea31c6 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:07.478050 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31aabf-49c0-46c4-9f4a-ae3eadea31c6 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:07.478050 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 509/1010] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:24:07 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:07.479206 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fcff9-7814-41f6-adff-c4f590d88bc8 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:07.479206 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fcff9-7814-41f6-adff-c4f590d88bc8 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:07.479206 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fcff9-7814-41f6-adff-c4f590d88bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:07.479206 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-5d2fcff9-7814-41f6-adff-c4f590d88bc8 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:07.479206 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-5d2fcff9-7814-41f6-adff-c4f590d88bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:07.479206 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 502/1011] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:24:07 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:24:07.499259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31aabf-49c0-46c4-9f4a-ae3eadea31c6 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:07.517519 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31aabf-49c0-46c4-9f4a-ae3eadea31c6 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:07.524672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13f04a-9b78-4926-8743-8789d1202a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:07.525525 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13f04a-9b78-4926-8743-8789d1202a2e service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:07.525904 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13f04a-9b78-4926-8743-8789d1202a2e service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:07.526273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13f04a-9b78-4926-8743-8789d1202a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:07.537491 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13f04a-9b78-4926-8743-8789d1202a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:07.540587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13f04a-9b78-4926-8743-8789d1202a2e service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:07.553251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 510/1012] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:07 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:11.038191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c211b-6819-4634-bb24-8f9ab27b03d7 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:11.039354 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c211b-6819-4634-bb24-8f9ab27b03d7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:11.039354 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c211b-6819-4634-bb24-8f9ab27b03d7 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:11.040878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 503/1013] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:24:11 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:11.047422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaa939-f4a5-4b19-91e1-17da0ce82e81 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:11.047907 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaa939-f4a5-4b19-91e1-17da0ce82e81 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:11.048008 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaa939-f4a5-4b19-91e1-17da0ce82e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:11.068244 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-efaaa939-f4a5-4b19-91e1-17da0ce82e81 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:11.069462 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-efaaa939-f4a5-4b19-91e1-17da0ce82e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:11.077856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 511/1014] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:24:11 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:11.125490 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c211b-6819-4634-bb24-8f9ab27b03d7 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:11.133051 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=46 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:11.139368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c211b-6819-4634-bb24-8f9ab27b03d7 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:11.145079 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de10fc3-0caf-4e3c-b71b-853e16e55e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:11.147052 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de10fc3-0caf-4e3c-b71b-853e16e55e5e service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:11.147052 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de10fc3-0caf-4e3c-b71b-853e16e55e5e service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:11.147052 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de10fc3-0caf-4e3c-b71b-853e16e55e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:11.156906 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de10fc3-0caf-4e3c-b71b-853e16e55e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:11.158495 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de10fc3-0caf-4e3c-b71b-853e16e55e5e service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:11.168657 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 504/1015] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:11 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:14.122018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f08ee2-fda8-40c8-a208-f2d5fbc651b4 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.122734 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f08ee2-fda8-40c8-a208-f2d5fbc651b4 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.122734 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f08ee2-fda8-40c8-a208-f2d5fbc651b4 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.123932 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 512/1016] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:24:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:14.129297 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53c19-014e-4cae-9fb8-25fe3ae57625 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.129811 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53c19-014e-4cae-9fb8-25fe3ae57625 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.129916 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53c19-014e-4cae-9fb8-25fe3ae57625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.149459 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-6ff53c19-014e-4cae-9fb8-25fe3ae57625 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:14.150646 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-6ff53c19-014e-4cae-9fb8-25fe3ae57625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:14.158588 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 505/1017] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:24:14 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:14.181592 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981f70-df4c-44a2-9231-a80313e0b397 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.181875 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981f70-df4c-44a2-9231-a80313e0b397 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.182156 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981f70-df4c-44a2-9231-a80313e0b397 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.183666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 513/1018] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:24:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:14.188619 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0225e-a9d8-4639-a0d0-c6fc018dc019 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.188911 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0225e-a9d8-4639-a0d0-c6fc018dc019 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.189192 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0225e-a9d8-4639-a0d0-c6fc018dc019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.204052 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981f70-df4c-44a2-9231-a80313e0b397 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:14.209413 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-16a0225e-a9d8-4639-a0d0-c6fc018dc019 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:14.210607 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-16a0225e-a9d8-4639-a0d0-c6fc018dc019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:14.217952 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981f70-df4c-44a2-9231-a80313e0b397 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:14.219036 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 506/1019] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:24:14 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:14.222967 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620faa8-35c6-4d4f-82fd-2e2dead3aa11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:14.223570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620faa8-35c6-4d4f-82fd-2e2dead3aa11 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.223849 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620faa8-35c6-4d4f-82fd-2e2dead3aa11 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.224663 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620faa8-35c6-4d4f-82fd-2e2dead3aa11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.233078 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620faa8-35c6-4d4f-82fd-2e2dead3aa11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:14.234690 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620faa8-35c6-4d4f-82fd-2e2dead3aa11 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:14.238661 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=100 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:14.245039 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 514/1020] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:14 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:24:14.277984 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86df931-a5fc-44b6-bcc9-3760ed7f83d7 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.278268 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86df931-a5fc-44b6-bcc9-3760ed7f83d7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.278543 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86df931-a5fc-44b6-bcc9-3760ed7f83d7 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.279871 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 507/1021] 10.222.0.100 () {54 vars in 971 bytes} [Tue Jul 26 15:24:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:14.285270 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220043a9-269e-4c0a-abb1-bdf9e81a7781 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.295923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220043a9-269e-4c0a-abb1-bdf9e81a7781 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.295923 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220043a9-269e-4c0a-abb1-bdf9e81a7781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.335647 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-220043a9-269e-4c0a-abb1-bdf9e81a7781 None None] MFA Rules not processed for user `4f62b11cb0dc462caeacfdba8cd45658`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:14.336870 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-220043a9-269e-4c0a-abb1-bdf9e81a7781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:14.397722 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 515/1022] 10.222.0.100 () {58 vars in 1068 bytes} [Tue Jul 26 15:24:14 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:14.405186 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86df931-a5fc-44b6-bcc9-3760ed7f83d7 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:14.416190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86df931-a5fc-44b6-bcc9-3760ed7f83d7 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:14.419825 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9458351-4e43-4566-ad68-0b8008252018 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f62b11cb0dc462caeacfdba8cd45658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:14.420462 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9458351-4e43-4566-ad68-0b8008252018 service glance] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:14.420741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9458351-4e43-4566-ad68-0b8008252018 service glance] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:14.421016 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9458351-4e43-4566-ad68-0b8008252018 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:14.430688 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9458351-4e43-4566-ad68-0b8008252018 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:14.432126 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9458351-4e43-4566-ad68-0b8008252018 service glance] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:14.441965 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 508/1023] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:14 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:24:16.700512 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fee6d-ac59-4584-885f-0d1f91394f2c None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.701157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fee6d-ac59-4584-885f-0d1f91394f2c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.701157 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fee6d-ac59-4584-885f-0d1f91394f2c None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.702517 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 516/1024] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:24:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:16.708046 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee984-9261-4719-af39-3742375ca5f9 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.709151 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee984-9261-4719-af39-3742375ca5f9 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.709258 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee984-9261-4719-af39-3742375ca5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.729727 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-5f7ee984-9261-4719-af39-3742375ca5f9 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:16.730939 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-5f7ee984-9261-4719-af39-3742375ca5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:16.740196 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 509/1025] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:24:16 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:16.786672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fee6d-ac59-4584-885f-0d1f91394f2c None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:16.800346 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fee6d-ac59-4584-885f-0d1f91394f2c None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:16.808068 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb601f-47ca-4453-8827-c2fc465e3ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:16.808801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb601f-47ca-4453-8827-c2fc465e3ee5 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:16.809166 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb601f-47ca-4453-8827-c2fc465e3ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:16.809523 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb601f-47ca-4453-8827-c2fc465e3ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:16.822836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb601f-47ca-4453-8827-c2fc465e3ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:16.826336 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb601f-47ca-4453-8827-c2fc465e3ee5 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:16.839219 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 517/1026] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:16 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:26.724545 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=20 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:26.834244 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=45 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:30.821127 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75cea-e5e2-4e5a-8c04-bf48f23bff56 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:30.821688 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75cea-e5e2-4e5a-8c04-bf48f23bff56 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:30.821688 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75cea-e5e2-4e5a-8c04-bf48f23bff56 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:30.822903 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 510/1027] 10.222.0.100 () {54 vars in 923 bytes} [Tue Jul 26 15:24:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:30.828313 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157a3f8-a4e5-4faa-ad32-e96f2529ef61 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:30.828821 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157a3f8-a4e5-4faa-ad32-e96f2529ef61 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:30.828917 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157a3f8-a4e5-4faa-ad32-e96f2529ef61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:30.861453 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-8157a3f8-a4e5-4faa-ad32-e96f2529ef61 None None] MFA Rules not processed for user `1fdf1646dad14825b7f78ba823af840f`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:30.863188 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-8157a3f8-a4e5-4faa-ad32-e96f2529ef61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:30.872631 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 518/1028] 10.222.0.100 () {58 vars in 1020 bytes} [Tue Jul 26 15:24:30 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:24:30.887218 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d7b51-43bf-4087-9a4c-e19d0c12caa6 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:30.887502 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d7b51-43bf-4087-9a4c-e19d0c12caa6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:30.887780 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d7b51-43bf-4087-9a4c-e19d0c12caa6 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:30.889267 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 511/1029] 10.222.0.100 () {54 vars in 923 bytes} [Tue Jul 26 15:24:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:30.894114 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f249b-64f4-4736-b194-1e80fddf47e7 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:30.894399 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f249b-64f4-4736-b194-1e80fddf47e7 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:30.894676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f249b-64f4-4736-b194-1e80fddf47e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:30.914811 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-7f6f249b-64f4-4736-b194-1e80fddf47e7 None None] MFA Rules not processed for user `dcc3cee241bd45c49e37124cc4dd6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:30.915990 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-7f6f249b-64f4-4736-b194-1e80fddf47e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:30.925317 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 519/1030] 10.222.0.100 () {58 vars in 1020 bytes} [Tue Jul 26 15:24:30 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:24:33.735961 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31daf8c-07f6-486c-9bc2-33796266acf3 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:33.736571 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31daf8c-07f6-486c-9bc2-33796266acf3 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:33.736571 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31daf8c-07f6-486c-9bc2-33796266acf3 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:33.737876 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 512/1031] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:24:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:33.744060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9dd42-5e07-45a4-86d2-30bbb52fc620 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:33.744516 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9dd42-5e07-45a4-86d2-30bbb52fc620 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:33.744630 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9dd42-5e07-45a4-86d2-30bbb52fc620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:33.764395 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-d9b9dd42-5e07-45a4-86d2-30bbb52fc620 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:33.765586 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-d9b9dd42-5e07-45a4-86d2-30bbb52fc620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:33.773959 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 520/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:24:33 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:33.818829 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31daf8c-07f6-486c-9bc2-33796266acf3 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:33.832064 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31daf8c-07f6-486c-9bc2-33796266acf3 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:33.837210 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155ef1e-8aab-4a00-a705-4761b199ea81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:33.837806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155ef1e-8aab-4a00-a705-4761b199ea81 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:33.838088 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155ef1e-8aab-4a00-a705-4761b199ea81 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:33.838360 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155ef1e-8aab-4a00-a705-4761b199ea81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:33.846790 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155ef1e-8aab-4a00-a705-4761b199ea81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:33.848394 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155ef1e-8aab-4a00-a705-4761b199ea81 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:33.858493 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 513/1033] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:33 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:34.826035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883c8e-454e-43c3-87ae-f8924e2e893e None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.826570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883c8e-454e-43c3-87ae-f8924e2e893e None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.826570 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883c8e-454e-43c3-87ae-f8924e2e893e None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.828021 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 521/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:24:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:34.833243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f453b38-d510-4d08-be72-29b5d05ce3db None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:34.833771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f453b38-d510-4d08-be72-29b5d05ce3db None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:34.834041 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f453b38-d510-4d08-be72-29b5d05ce3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:34.860812 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-4f453b38-d510-4d08-be72-29b5d05ce3db None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:34.862124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-4f453b38-d510-4d08-be72-29b5d05ce3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:34.870535 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 514/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:24:34 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:35.049511 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883c8e-454e-43c3-87ae-f8924e2e893e None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:35.063055 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883c8e-454e-43c3-87ae-f8924e2e893e None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:35.067933 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a729e7d-03d4-40e1-a307-6bdfd63c0b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:35.069096 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729e7d-03d4-40e1-a307-6bdfd63c0b22 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:35.069376 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729e7d-03d4-40e1-a307-6bdfd63c0b22 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:35.069650 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a729e7d-03d4-40e1-a307-6bdfd63c0b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:35.077618 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a729e7d-03d4-40e1-a307-6bdfd63c0b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:35.079207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a729e7d-03d4-40e1-a307-6bdfd63c0b22 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:35.088735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 522/1036] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:35 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:36.016548 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753be72-1650-44af-be09-1c172c14408c None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.017124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753be72-1650-44af-be09-1c172c14408c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.017235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753be72-1650-44af-be09-1c172c14408c None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.018552 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 515/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:24:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:36.024479 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5198f-6f6a-4d51-b6d8-2a06cc028c48 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.024874 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5198f-6f6a-4d51-b6d8-2a06cc028c48 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.028603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5198f-6f6a-4d51-b6d8-2a06cc028c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.044368 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-99d5198f-6f6a-4d51-b6d8-2a06cc028c48 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:36.045548 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-99d5198f-6f6a-4d51-b6d8-2a06cc028c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:36.053932 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 523/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:24:36 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:36.209704 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753be72-1650-44af-be09-1c172c14408c None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:36.222849 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753be72-1650-44af-be09-1c172c14408c None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:36.227813 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab885b4-0824-482c-863f-1198105cf390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:36.228441 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab885b4-0824-482c-863f-1198105cf390 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:36.228723 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab885b4-0824-482c-863f-1198105cf390 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:36.228995 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab885b4-0824-482c-863f-1198105cf390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:36.237124 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab885b4-0824-482c-863f-1198105cf390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:36.238678 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab885b4-0824-482c-863f-1198105cf390 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:36.247849 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 516/1039] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:36 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:24:37.119123 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29f61c-0ec3-41da-9987-7467c530430f None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:37.119668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29f61c-0ec3-41da-9987-7467c530430f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:37.119668 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29f61c-0ec3-41da-9987-7467c530430f None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:37.121054 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 524/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:24:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:37.125913 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76408001-38a1-4ff3-b840-7bd6717163b6 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:37.126325 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76408001-38a1-4ff3-b840-7bd6717163b6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:37.126471 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76408001-38a1-4ff3-b840-7bd6717163b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:37.145568 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-76408001-38a1-4ff3-b840-7bd6717163b6 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:37.147285 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-76408001-38a1-4ff3-b840-7bd6717163b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:37.155388 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 517/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:24:37 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:37.310249 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29f61c-0ec3-41da-9987-7467c530430f None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:37.324028 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29f61c-0ec3-41da-9987-7467c530430f None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:37.329011 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2868629-8f40-402b-8e63-8e340c54857e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:37.329848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2868629-8f40-402b-8e63-8e340c54857e service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:37.330137 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2868629-8f40-402b-8e63-8e340c54857e service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:37.330415 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2868629-8f40-402b-8e63-8e340c54857e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:37.339137 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2868629-8f40-402b-8e63-8e340c54857e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:37.340772 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2868629-8f40-402b-8e63-8e340c54857e service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:37.350695 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 525/1042] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:37 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:38.216085 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82624b57-a4e3-4165-9dc2-ce3f58cd5073 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:38.216702 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82624b57-a4e3-4165-9dc2-ce3f58cd5073 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:38.216702 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82624b57-a4e3-4165-9dc2-ce3f58cd5073 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:38.218012 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 518/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:24:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:38.222898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020acb1-41b3-4094-87b7-32d4d0555b44 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:38.223324 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020acb1-41b3-4094-87b7-32d4d0555b44 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:38.223435 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020acb1-41b3-4094-87b7-32d4d0555b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:38.243690 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-9020acb1-41b3-4094-87b7-32d4d0555b44 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:38.244938 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-9020acb1-41b3-4094-87b7-32d4d0555b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:38.253456 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 526/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:24:38 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:38.409746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82624b57-a4e3-4165-9dc2-ce3f58cd5073 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:38.423340 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82624b57-a4e3-4165-9dc2-ce3f58cd5073 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:38.428749 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741d788-2635-4e39-bd85-7a899765aab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:38.429341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741d788-2635-4e39-bd85-7a899765aab7 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:38.429657 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741d788-2635-4e39-bd85-7a899765aab7 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:38.429931 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741d788-2635-4e39-bd85-7a899765aab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:38.437964 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741d788-2635-4e39-bd85-7a899765aab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:38.439529 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741d788-2635-4e39-bd85-7a899765aab7 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:38.448716 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 519/1045] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:38 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:39.346843 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e3bba-1cbd-490f-8552-726c1fb922c6 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:39.347619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e3bba-1cbd-490f-8552-726c1fb922c6 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:39.347619 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e3bba-1cbd-490f-8552-726c1fb922c6 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:39.348765 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 527/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:24:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:39.354021 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c469f-a992-4f39-b0a7-73b6c2b83943 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:39.354464 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c469f-a992-4f39-b0a7-73b6c2b83943 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:39.354573 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c469f-a992-4f39-b0a7-73b6c2b83943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:39.374089 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-551c469f-a992-4f39-b0a7-73b6c2b83943 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:39.375262 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-551c469f-a992-4f39-b0a7-73b6c2b83943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:39.384542 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 520/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:24:39 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:39.543710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e3bba-1cbd-490f-8552-726c1fb922c6 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:39.557736 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e3bba-1cbd-490f-8552-726c1fb922c6 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:39.562679 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7dc23-adde-447d-99a1-ebbbfbde790d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:39.563282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7dc23-adde-447d-99a1-ebbbfbde790d service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:39.563565 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7dc23-adde-447d-99a1-ebbbfbde790d service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:39.563841 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7dc23-adde-447d-99a1-ebbbfbde790d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:39.572623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7dc23-adde-447d-99a1-ebbbfbde790d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:39.574191 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7dc23-adde-447d-99a1-ebbbfbde790d service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:39.583367 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 528/1048] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:39 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:40.501165 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9cdec-738a-42be-891b-5efab5fe838f None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:40.501606 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9cdec-738a-42be-891b-5efab5fe838f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:40.501792 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9cdec-738a-42be-891b-5efab5fe838f None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:40.503139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 521/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:24:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:40.508876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a46824-1e14-488a-b5b9-64012fa23fef None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:40.509316 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a46824-1e14-488a-b5b9-64012fa23fef None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:40.509411 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a46824-1e14-488a-b5b9-64012fa23fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:40.529409 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-a6a46824-1e14-488a-b5b9-64012fa23fef None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:40.530596 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-a6a46824-1e14-488a-b5b9-64012fa23fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:40.542294 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 529/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:24:40 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:40.701174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9cdec-738a-42be-891b-5efab5fe838f None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:40.715149 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9cdec-738a-42be-891b-5efab5fe838f None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:40.720279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d83e09-620f-436f-a159-2edfb5b87c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:40.720885 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d83e09-620f-436f-a159-2edfb5b87c2e service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:40.721165 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d83e09-620f-436f-a159-2edfb5b87c2e service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:40.721440 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d83e09-620f-436f-a159-2edfb5b87c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:40.729794 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d83e09-620f-436f-a159-2edfb5b87c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:40.731369 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d83e09-620f-436f-a159-2edfb5b87c2e service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:40.740603 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 522/1051] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:40 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:24:41.670579 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35236c9-9a7e-4756-8ff3-9697ca8d4793 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.671186 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35236c9-9a7e-4756-8ff3-9697ca8d4793 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.671312 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35236c9-9a7e-4756-8ff3-9697ca8d4793 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.672852 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 530/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:24:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:41.678236 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43fa7-3ccf-4b7a-9395-46a4c367748f None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.678642 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43fa7-3ccf-4b7a-9395-46a4c367748f None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.678851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd43fa7-3ccf-4b7a-9395-46a4c367748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.698631 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-7cd43fa7-3ccf-4b7a-9395-46a4c367748f None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:41.699833 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-7cd43fa7-3ccf-4b7a-9395-46a4c367748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:41.707689 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 523/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:24:41 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:41.866324 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35236c9-9a7e-4756-8ff3-9697ca8d4793 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:41.879685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35236c9-9a7e-4756-8ff3-9697ca8d4793 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:41.885248 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1069e3-5dcc-437e-8770-55ec68832506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:41.885849 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1069e3-5dcc-437e-8770-55ec68832506 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:41.886133 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1069e3-5dcc-437e-8770-55ec68832506 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:41.886413 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1069e3-5dcc-437e-8770-55ec68832506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:41.894544 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1069e3-5dcc-437e-8770-55ec68832506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:41.896181 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1069e3-5dcc-437e-8770-55ec68832506 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:41.905763 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 531/1054] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:41 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:42.795195 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270340b-27a1-4cbb-8f80-5cc0ab90868a None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:42.795735 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270340b-27a1-4cbb-8f80-5cc0ab90868a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:42.795735 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270340b-27a1-4cbb-8f80-5cc0ab90868a None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:42.797600 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 524/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:24:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:42.803270 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92528a-c343-4c06-886f-1a42fd7c93c8 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:42.803754 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92528a-c343-4c06-886f-1a42fd7c93c8 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:42.803867 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92528a-c343-4c06-886f-1a42fd7c93c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:42.824201 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-bc92528a-c343-4c06-886f-1a42fd7c93c8 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:42.825395 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-bc92528a-c343-4c06-886f-1a42fd7c93c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:42.834144 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 532/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:24:42 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:42.987870 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270340b-27a1-4cbb-8f80-5cc0ab90868a None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:43.001125 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270340b-27a1-4cbb-8f80-5cc0ab90868a None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:43.006512 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0325ad-2701-4c34-8747-4dc3fe9370df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:43.007091 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0325ad-2701-4c34-8747-4dc3fe9370df service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:43.007372 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0325ad-2701-4c34-8747-4dc3fe9370df service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:43.007645 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0325ad-2701-4c34-8747-4dc3fe9370df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:43.015742 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0325ad-2701-4c34-8747-4dc3fe9370df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:43.017383 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0325ad-2701-4c34-8747-4dc3fe9370df service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:43.027445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 525/1057] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:42 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:45.171089 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b018619-54a6-4404-9101-82efd13ab60d None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.171637 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b018619-54a6-4404-9101-82efd13ab60d None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.171637 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b018619-54a6-4404-9101-82efd13ab60d None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.173071 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 533/1058] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:24:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:45.178426 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efec7b3-65ed-4dc3-993e-2641bb7ff083 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.178879 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efec7b3-65ed-4dc3-993e-2641bb7ff083 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.178986 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efec7b3-65ed-4dc3-993e-2641bb7ff083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.197980 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-8efec7b3-65ed-4dc3-993e-2641bb7ff083 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:45.199158 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-8efec7b3-65ed-4dc3-993e-2641bb7ff083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:45.207091 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 526/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:24:45 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:45.247088 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b018619-54a6-4404-9101-82efd13ab60d None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:45.258391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b018619-54a6-4404-9101-82efd13ab60d None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:45.261928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f242103-6e0f-42d0-8bd8-282590c35d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:45.262532 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f242103-6e0f-42d0-8bd8-282590c35d70 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:45.262816 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f242103-6e0f-42d0-8bd8-282590c35d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:45.263091 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f242103-6e0f-42d0-8bd8-282590c35d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:45.272749 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f242103-6e0f-42d0-8bd8-282590c35d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:45.275292 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f242103-6e0f-42d0-8bd8-282590c35d70 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:45.293124 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 534/1060] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:45 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:47.679086 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1ba5-9b47-4e0d-b4de-3b496059550a None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:47.679636 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1ba5-9b47-4e0d-b4de-3b496059550a None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:47.679636 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1ba5-9b47-4e0d-b4de-3b496059550a None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:47.681060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 527/1061] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:24:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:47.686301 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96a675-0db1-4d25-b9d6-6605208e6506 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:47.686880 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96a675-0db1-4d25-b9d6-6605208e6506 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:47.686980 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96a675-0db1-4d25-b9d6-6605208e6506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:47.706343 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-1c96a675-0db1-4d25-b9d6-6605208e6506 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:47.707533 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-1c96a675-0db1-4d25-b9d6-6605208e6506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:47.715876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 535/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:24:47 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:47.757457 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b1ba5-9b47-4e0d-b4de-3b496059550a None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:47.768173 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b1ba5-9b47-4e0d-b4de-3b496059550a None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:47.772067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601c0cf-3e86-43f8-864a-bc21dce9cded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:47.772690 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601c0cf-3e86-43f8-864a-bc21dce9cded service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:47.773025 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601c0cf-3e86-43f8-864a-bc21dce9cded service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:47.773298 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601c0cf-3e86-43f8-864a-bc21dce9cded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:47.782522 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601c0cf-3e86-43f8-864a-bc21dce9cded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:47.783948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601c0cf-3e86-43f8-864a-bc21dce9cded service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:47.793564 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 528/1063] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:47 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:50.365603 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd71246-489e-42a7-9b30-7e56eb2e2392 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:50.366060 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd71246-489e-42a7-9b30-7e56eb2e2392 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:50.366154 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd71246-489e-42a7-9b30-7e56eb2e2392 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:50.367632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 536/1064] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:24:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:50.373471 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211daca-afb6-464a-bab6-a6453bc33ad9 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:50.380161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211daca-afb6-464a-bab6-a6453bc33ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:50.380161 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211daca-afb6-464a-bab6-a6453bc33ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:50.393081 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-e211daca-afb6-464a-bab6-a6453bc33ad9 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:50.394280 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e211daca-afb6-464a-bab6-a6453bc33ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:50.402363 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 529/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:24:50 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:50.443386 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd71246-489e-42a7-9b30-7e56eb2e2392 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:50.454206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd71246-489e-42a7-9b30-7e56eb2e2392 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:50.457795 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbbfa6-7fe1-46bc-a777-848aecc2444d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:50.458401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbbfa6-7fe1-46bc-a777-848aecc2444d service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:50.458685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbbfa6-7fe1-46bc-a777-848aecc2444d service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:50.458960 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbbfa6-7fe1-46bc-a777-848aecc2444d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:50.470906 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbbfa6-7fe1-46bc-a777-848aecc2444d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:50.472463 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbbfa6-7fe1-46bc-a777-848aecc2444d service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:50.483551 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 537/1066] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:50 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:52.861716 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f59698-9ce7-4eac-aa95-3cd935c34c28 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:52.862284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f59698-9ce7-4eac-aa95-3cd935c34c28 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:52.862284 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f59698-9ce7-4eac-aa95-3cd935c34c28 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:52.863599 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 530/1067] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:24:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:52.869302 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf438be-50fa-4405-9a30-2dbd97c41c63 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:52.869709 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf438be-50fa-4405-9a30-2dbd97c41c63 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:52.869862 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf438be-50fa-4405-9a30-2dbd97c41c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:52.889660 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-cdf438be-50fa-4405-9a30-2dbd97c41c63 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:52.890856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-cdf438be-50fa-4405-9a30-2dbd97c41c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:52.898738 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 538/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:24:52 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:52.939316 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f59698-9ce7-4eac-aa95-3cd935c34c28 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:52.950798 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f59698-9ce7-4eac-aa95-3cd935c34c28 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:52.955319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698fc2da-44c9-4430-88d1-aeb304e12ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:52.955925 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fc2da-44c9-4430-88d1-aeb304e12ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:52.956246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fc2da-44c9-4430-88d1-aeb304e12ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:52.956532 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698fc2da-44c9-4430-88d1-aeb304e12ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:52.965492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fc2da-44c9-4430-88d1-aeb304e12ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:52.966932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698fc2da-44c9-4430-88d1-aeb304e12ce9 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:52.976132 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 531/1069] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:52 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:55.338977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dcf0c-1f95-4cdf-aca6-5343ad259f46 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:55.339546 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dcf0c-1f95-4cdf-aca6-5343ad259f46 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:55.339546 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0dcf0c-1f95-4cdf-aca6-5343ad259f46 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:55.340898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 539/1070] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:24:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:55.346129 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f28e-d392-4712-a377-92a48405ca44 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:55.346575 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f28e-d392-4712-a377-92a48405ca44 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:55.346688 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f28e-d392-4712-a377-92a48405ca44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:55.365952 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-80b5f28e-d392-4712-a377-92a48405ca44 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:55.367139 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-80b5f28e-d392-4712-a377-92a48405ca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:55.374923 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 532/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:24:55 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:55.414645 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dcf0c-1f95-4cdf-aca6-5343ad259f46 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:55.426048 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0dcf0c-1f95-4cdf-aca6-5343ad259f46 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:55.429637 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb367f-1276-433f-a62c-2755d025786a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:55.430224 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb367f-1276-433f-a62c-2755d025786a service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:55.430503 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb367f-1276-433f-a62c-2755d025786a service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:55.430780 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb367f-1276-433f-a62c-2755d025786a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:55.439797 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb367f-1276-433f-a62c-2755d025786a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:55.441273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb367f-1276-433f-a62c-2755d025786a service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:55.451318 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 540/1072] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:55 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:24:57.731908 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df959ca-d846-4427-980a-16baf70580f0 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:57.732497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df959ca-d846-4427-980a-16baf70580f0 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:57.732497 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df959ca-d846-4427-980a-16baf70580f0 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:57.734004 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 533/1073] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:24:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:24:57.739290 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd03c0-44b1-4f21-9ef6-8033db7ec309 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:57.739879 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd03c0-44b1-4f21-9ef6-8033db7ec309 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:57.739984 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd03c0-44b1-4f21-9ef6-8033db7ec309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:57.747351 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=75 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:57.760710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-3bdd03c0-44b1-4f21-9ef6-8033db7ec309 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:24:57.761920 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-3bdd03c0-44b1-4f21-9ef6-8033db7ec309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:24:57.770601 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 541/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:24:57 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:24:57.810447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df959ca-d846-4427-980a-16baf70580f0 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:24:57.816093 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=64 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:57.822481 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df959ca-d846-4427-980a-16baf70580f0 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:24:57.826078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c0789-f74b-45c1-8dc4-82962943994f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:24:57.826670 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c0789-f74b-45c1-8dc4-82962943994f service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:24:57.826947 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c0789-f74b-45c1-8dc4-82962943994f service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:24:57.827218 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c0789-f74b-45c1-8dc4-82962943994f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:24:57.836714 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c0789-f74b-45c1-8dc4-82962943994f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:24:57.838212 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c0789-f74b-45c1-8dc4-82962943994f service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:24:57.847500 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 534/1075] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:24:57 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:00.166420 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020aa7-c903-4cac-baf5-742eead28869 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.167018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020aa7-c903-4cac-baf5-742eead28869 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.167018 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020aa7-c903-4cac-baf5-742eead28869 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.168385 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 542/1076] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:25:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:25:00.173551 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cb772-9dca-400c-976d-5a443758965b None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.174003 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cb772-9dca-400c-976d-5a443758965b None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.174112 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cb772-9dca-400c-976d-5a443758965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.193861 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-cb8cb772-9dca-400c-976d-5a443758965b None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:00.196590 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-cb8cb772-9dca-400c-976d-5a443758965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:00.203093 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 535/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:25:00 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:00.242402 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4020aa7-c903-4cac-baf5-742eead28869 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:00.253171 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4020aa7-c903-4cac-baf5-742eead28869 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:00.257271 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f49c3-5db0-47b5-abd5-3604ae872779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:00.257876 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f49c3-5db0-47b5-abd5-3604ae872779 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:00.258161 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f49c3-5db0-47b5-abd5-3604ae872779 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:00.258438 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f49c3-5db0-47b5-abd5-3604ae872779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:00.267387 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f49c3-5db0-47b5-abd5-3604ae872779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:00.268901 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f49c3-5db0-47b5-abd5-3604ae872779 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:00.280153 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 543/1078] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:25:00 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:02.566357 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4921c7-0576-4525-835b-b8f0dde4e20c None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.566867 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4921c7-0576-4525-835b-b8f0dde4e20c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.566975 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4921c7-0576-4525-835b-b8f0dde4e20c None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.568344 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 536/1079] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:25:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:02.573610 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0342fd-0c4a-48d9-853a-cea0967d4982 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.574011 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0342fd-0c4a-48d9-853a-cea0967d4982 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.574174 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0342fd-0c4a-48d9-853a-cea0967d4982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.594153 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-7c0342fd-0c4a-48d9-853a-cea0967d4982 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:02.595385 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-7c0342fd-0c4a-48d9-853a-cea0967d4982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:02.603864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 544/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:25:02 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:02.641802 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4921c7-0576-4525-835b-b8f0dde4e20c None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:02.653456 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4921c7-0576-4525-835b-b8f0dde4e20c None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:02.657104 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9bd78-2f2a-4b99-90bf-75ccc5d110ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:02.657700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9bd78-2f2a-4b99-90bf-75ccc5d110ae service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:02.657982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9bd78-2f2a-4b99-90bf-75ccc5d110ae service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:02.658260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9bd78-2f2a-4b99-90bf-75ccc5d110ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:02.667981 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9bd78-2f2a-4b99-90bf-75ccc5d110ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:02.669442 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9bd78-2f2a-4b99-90bf-75ccc5d110ae service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:02.679979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 537/1081] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:25:02 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:04.929829 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53d72c-72ad-4449-8df1-da42c8cf7578 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:04.930388 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53d72c-72ad-4449-8df1-da42c8cf7578 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:04.930388 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53d72c-72ad-4449-8df1-da42c8cf7578 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:04.931710 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 545/1082] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:25:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:04.936987 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec554-5f0a-472c-90fb-8423d65a9c07 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:04.937382 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec554-5f0a-472c-90fb-8423d65a9c07 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:04.937536 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eec554-5f0a-472c-90fb-8423d65a9c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:04.956048 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-f0eec554-5f0a-472c-90fb-8423d65a9c07 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:04.957275 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-f0eec554-5f0a-472c-90fb-8423d65a9c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:04.965483 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 538/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:25:04 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:05.003771 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53d72c-72ad-4449-8df1-da42c8cf7578 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:05.014627 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53d72c-72ad-4449-8df1-da42c8cf7578 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:05.018265 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a4c5b-3adf-4f58-981c-3e4fbc306f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:05.018868 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4c5b-3adf-4f58-981c-3e4fbc306f3d service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:05.019168 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4c5b-3adf-4f58-981c-3e4fbc306f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:05.019446 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4c5b-3adf-4f58-981c-3e4fbc306f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:05.029428 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a4c5b-3adf-4f58-981c-3e4fbc306f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:05.030896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a4c5b-3adf-4f58-981c-3e4fbc306f3d service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:05.040776 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 546/1084] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:25:05 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:07.320888 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d2042-e6bb-494a-ac7e-af2a6a03d16d None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.321478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d2042-e6bb-494a-ac7e-af2a6a03d16d None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.321478 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d2042-e6bb-494a-ac7e-af2a6a03d16d None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.322795 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 539/1085] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:25:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:07.328098 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8d597-1ff4-44d1-9522-f6a8deacaa09 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.328533 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8d597-1ff4-44d1-9522-f6a8deacaa09 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.333666 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8d597-1ff4-44d1-9522-f6a8deacaa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.347776 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-fda8d597-1ff4-44d1-9522-f6a8deacaa09 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:07.349010 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-fda8d597-1ff4-44d1-9522-f6a8deacaa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:07.356918 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 547/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:25:07 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:07.395851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d2042-e6bb-494a-ac7e-af2a6a03d16d None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:07.407443 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d2042-e6bb-494a-ac7e-af2a6a03d16d None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:07.411913 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875d116-1cc9-4c54-9b4b-e8bbabf10e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:07.412711 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875d116-1cc9-4c54-9b4b-e8bbabf10e4c service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:07.413075 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875d116-1cc9-4c54-9b4b-e8bbabf10e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:07.413396 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875d116-1cc9-4c54-9b4b-e8bbabf10e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:07.422096 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875d116-1cc9-4c54-9b4b-e8bbabf10e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:07.423521 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875d116-1cc9-4c54-9b4b-e8bbabf10e4c service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:07.434339 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 540/1087] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:25:07 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:17.342849 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=20 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:17.429758 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=23 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:31.538297 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da554ff-b17a-41c7-ab7a-826bbaf341b4 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.538884 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da554ff-b17a-41c7-ab7a-826bbaf341b4 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.538884 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da554ff-b17a-41c7-ab7a-826bbaf341b4 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.540216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 548/1088] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:25:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:31.545326 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802c647-bd5e-4abf-9f9d-880773ca4aa6 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.545736 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802c647-bd5e-4abf-9f9d-880773ca4aa6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.545896 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802c647-bd5e-4abf-9f9d-880773ca4aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.564667 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-d802c647-bd5e-4abf-9f9d-880773ca4aa6 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:31.565875 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-d802c647-bd5e-4abf-9f9d-880773ca4aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:31.574491 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 541/1089] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:25:31 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:31.625445 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16232f08-45fa-4f53-81d0-3e02e1ab3347 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.625734 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16232f08-45fa-4f53-81d0-3e02e1ab3347 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.626012 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16232f08-45fa-4f53-81d0-3e02e1ab3347 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.627471 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 549/1090] 10.222.0.100 () {54 vars in 971 bytes} [Tue Jul 26 15:25:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:31.633485 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a385-c3ae-4bbd-bc4c-15916e90e045 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.633778 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a385-c3ae-4bbd-bc4c-15916e90e045 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.634061 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a385-c3ae-4bbd-bc4c-15916e90e045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.653866 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-53d8a385-c3ae-4bbd-bc4c-15916e90e045 None None] MFA Rules not processed for user `4f62b11cb0dc462caeacfdba8cd45658`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:31.655067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-53d8a385-c3ae-4bbd-bc4c-15916e90e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:31.661512 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 542/1091] 10.222.0.100 () {58 vars in 1068 bytes} [Tue Jul 26 15:25:31 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:31.669088 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16232f08-45fa-4f53-81d0-3e02e1ab3347 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:31.685134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16232f08-45fa-4f53-81d0-3e02e1ab3347 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:31.689150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec8e0c-30f5-4f3f-8ae6-b5e2b29c00d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f62b11cb0dc462caeacfdba8cd45658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:31.689752 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec8e0c-30f5-4f3f-8ae6-b5e2b29c00d9 service glance] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:31.690053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec8e0c-30f5-4f3f-8ae6-b5e2b29c00d9 service glance] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:31.690516 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec8e0c-30f5-4f3f-8ae6-b5e2b29c00d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:31.700659 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec8e0c-30f5-4f3f-8ae6-b5e2b29c00d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:31.702122 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec8e0c-30f5-4f3f-8ae6-b5e2b29c00d9 service glance] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:31.712656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 550/1092] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:25:31 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:34.049310 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f923da8-c8a1-4651-abcc-718faacfebcf None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:34.049899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f923da8-c8a1-4651-abcc-718faacfebcf None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:34.049899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f923da8-c8a1-4651-abcc-718faacfebcf None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:34.051198 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 543/1093] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:25:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:34.057589 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1beaf5-a5a0-4e4c-ba7d-ced35999457c None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:34.058035 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1beaf5-a5a0-4e4c-ba7d-ced35999457c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:34.058241 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1beaf5-a5a0-4e4c-ba7d-ced35999457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:34.078420 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-4c1beaf5-a5a0-4e4c-ba7d-ced35999457c None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:34.079593 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-4c1beaf5-a5a0-4e4c-ba7d-ced35999457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:34.087339 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 551/1094] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:25:34 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:34.114002 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f923da8-c8a1-4651-abcc-718faacfebcf None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:34.128618 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f923da8-c8a1-4651-abcc-718faacfebcf None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:34.133550 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e1f29-c6ea-4c71-a1ca-48f7cf07ba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:34.134142 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e1f29-c6ea-4c71-a1ca-48f7cf07ba87 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:34.134440 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e1f29-c6ea-4c71-a1ca-48f7cf07ba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:34.134711 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e1f29-c6ea-4c71-a1ca-48f7cf07ba87 admin admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:34.135392 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e1f29-c6ea-4c71-a1ca-48f7cf07ba87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:34.137156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-c61e1f29-c6ea-4c71-a1ca-48f7cf07ba87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:25:34.137156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 26 15:25:34.137156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: Jul 26 15:25:34.138296 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e1f29-c6ea-4c71-a1ca-48f7cf07ba87 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:34.156910 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 544/1095] 10.222.0.100 () {56 vars in 1113 bytes} [Tue Jul 26 15:25:34 2022] GET /identity/v3/projects => generated 1612 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:25:36.436680 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6095adb-adf7-4d00-b845-15325dea1833 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.437343 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6095adb-adf7-4d00-b845-15325dea1833 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.437343 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6095adb-adf7-4d00-b845-15325dea1833 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.439027 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 552/1096] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:25:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:36.444188 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd059ab4-fee4-4bb0-a688-80417dad36c1 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.444663 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd059ab4-fee4-4bb0-a688-80417dad36c1 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.444769 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd059ab4-fee4-4bb0-a688-80417dad36c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.463932 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-bd059ab4-fee4-4bb0-a688-80417dad36c1 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:36.465138 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-bd059ab4-fee4-4bb0-a688-80417dad36c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:36.472851 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 545/1097] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:25:36 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:36.518320 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6095adb-adf7-4d00-b845-15325dea1833 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:36.535447 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6095adb-adf7-4d00-b845-15325dea1833 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:36.541540 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcf5c3-115b-47f9-ad84-c591a78b10ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:36.542147 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcf5c3-115b-47f9-ad84-c591a78b10ab service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:36.542429 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcf5c3-115b-47f9-ad84-c591a78b10ab service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:36.542702 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcf5c3-115b-47f9-ad84-c591a78b10ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:36.551485 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcf5c3-115b-47f9-ad84-c591a78b10ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:36.553092 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcf5c3-115b-47f9-ad84-c591a78b10ab service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:36.562641 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 553/1098] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:25:36 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:38.964775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac9f3e-6454-40f9-ac70-ec0d2fba0da4 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:38.965341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac9f3e-6454-40f9-ac70-ec0d2fba0da4 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:38.965341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac9f3e-6454-40f9-ac70-ec0d2fba0da4 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:38.966647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 546/1099] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:25:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:38.971826 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7407-1857-4765-b675-e04a37533368 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:38.972251 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7407-1857-4765-b675-e04a37533368 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:38.972396 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7407-1857-4765-b675-e04a37533368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:38.991201 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-e5ca7407-1857-4765-b675-e04a37533368 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:38.992450 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-e5ca7407-1857-4765-b675-e04a37533368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:39.000221 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 554/1100] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:25:38 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:39.044215 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac9f3e-6454-40f9-ac70-ec0d2fba0da4 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:39.072043 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac9f3e-6454-40f9-ac70-ec0d2fba0da4 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:39.080314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7050d2a-e63c-449f-af00-0f93d50585d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:39.080933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050d2a-e63c-449f-af00-0f93d50585d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:39.081213 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050d2a-e63c-449f-af00-0f93d50585d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:39.081486 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7050d2a-e63c-449f-af00-0f93d50585d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:39.091122 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7050d2a-e63c-449f-af00-0f93d50585d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:39.092590 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7050d2a-e63c-449f-af00-0f93d50585d5 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:39.101726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 547/1101] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:25:39 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:41.421165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f274c-489f-4116-bfb0-5d6e6c07eeee None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.421748 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f274c-489f-4116-bfb0-5d6e6c07eeee None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.421880 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f274c-489f-4116-bfb0-5d6e6c07eeee None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.423407 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 555/1102] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:25:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:41.428810 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405254-80f2-422c-89fc-1cf37484b126 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.429307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405254-80f2-422c-89fc-1cf37484b126 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.429411 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405254-80f2-422c-89fc-1cf37484b126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.449972 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-21405254-80f2-422c-89fc-1cf37484b126 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:41.451191 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-21405254-80f2-422c-89fc-1cf37484b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:41.459297 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 548/1103] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:25:41 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:41.499587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f274c-489f-4116-bfb0-5d6e6c07eeee None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:41.510657 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f274c-489f-4116-bfb0-5d6e6c07eeee None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:41.514169 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71f50e-9088-4913-80d2-a454a0ffa86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:41.514913 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f50e-9088-4913-80d2-a454a0ffa86b service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:41.515191 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f50e-9088-4913-80d2-a454a0ffa86b service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:41.515461 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71f50e-9088-4913-80d2-a454a0ffa86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:41.525870 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71f50e-9088-4913-80d2-a454a0ffa86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:41.527482 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71f50e-9088-4913-80d2-a454a0ffa86b service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:41.538143 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 556/1104] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:25:41 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:25:44.096309 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4c73d-52ca-4e95-834d-fcf6df9120a7 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:44.096884 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4c73d-52ca-4e95-834d-fcf6df9120a7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:44.096884 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4c73d-52ca-4e95-834d-fcf6df9120a7 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:44.098183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 549/1105] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:25:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:44.104502 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac56cc-4eca-4043-b85c-d8942f23640f None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:44.105015 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac56cc-4eca-4043-b85c-d8942f23640f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:44.105121 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac56cc-4eca-4043-b85c-d8942f23640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:44.126481 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-6bac56cc-4eca-4043-b85c-d8942f23640f None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:44.127692 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-6bac56cc-4eca-4043-b85c-d8942f23640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:44.136732 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 557/1106] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:25:44 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:44.184691 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4c73d-52ca-4e95-834d-fcf6df9120a7 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:44.203257 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4c73d-52ca-4e95-834d-fcf6df9120a7 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:44.209904 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da34b8c-223c-413b-a780-c0464f306c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:44.210515 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34b8c-223c-413b-a780-c0464f306c3e service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:44.210797 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34b8c-223c-413b-a780-c0464f306c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:44.211071 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34b8c-223c-413b-a780-c0464f306c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:44.224592 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da34b8c-223c-413b-a780-c0464f306c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:44.226013 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da34b8c-223c-413b-a780-c0464f306c3e service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:44.235773 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 550/1107] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:25:44 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:25:46.928141 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8630f4-8060-4b9f-9fcb-036984c526ba None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:46.928654 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8630f4-8060-4b9f-9fcb-036984c526ba None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:46.928654 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8630f4-8060-4b9f-9fcb-036984c526ba None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:46.929955 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 558/1108] 10.222.0.100 () {54 vars in 931 bytes} [Tue Jul 26 15:25:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:25:46.935414 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17125-bfd0-4026-ba1c-82751a804aff None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:46.935864 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17125-bfd0-4026-ba1c-82751a804aff None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:46.935982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd17125-bfd0-4026-ba1c-82751a804aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:46.956101 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-7dd17125-bfd0-4026-ba1c-82751a804aff None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:25:46.957330 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-7dd17125-bfd0-4026-ba1c-82751a804aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:25:46.965122 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 551/1109] 10.222.0.100 () {58 vars in 1028 bytes} [Tue Jul 26 15:25:46 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:25:47.013622 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8630f4-8060-4b9f-9fcb-036984c526ba None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:25:47.023730 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8630f4-8060-4b9f-9fcb-036984c526ba None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:25:47.027778 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a78b4-f75b-4f5b-a40c-600bacde9c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:25:47.028427 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a78b4-f75b-4f5b-a40c-600bacde9c67 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:25:47.028705 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a78b4-f75b-4f5b-a40c-600bacde9c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:25:47.028972 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a78b4-f75b-4f5b-a40c-600bacde9c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:25:47.040843 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a78b4-f75b-4f5b-a40c-600bacde9c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:25:47.043097 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a78b4-f75b-4f5b-a40c-600bacde9c67 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:25:47.057881 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 559/1110] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:25:47 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:25:56.951238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=33 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:57.050717 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=33 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:27.329419 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecce3a-645e-4ea2-80b7-a22789d1c4c6 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:27.340153 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecce3a-645e-4ea2-80b7-a22789d1c4c6 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:27.340153 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecce3a-645e-4ea2-80b7-a22789d1c4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:27.350604 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b1ecce3a-645e-4ea2-80b7-a22789d1c4c6 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:27:27.351895 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b1ecce3a-645e-4ea2-80b7-a22789d1c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:27.360822 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 552/1111] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:27:27 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:27:27.369556 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01d25-4989-4a44-bdfe-e99bcbac6d6d None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:27.370728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01d25-4989-4a44-bdfe-e99bcbac6d6d None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:27.370728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac01d25-4989-4a44-bdfe-e99bcbac6d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:27.390038 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-6ac01d25-4989-4a44-bdfe-e99bcbac6d6d None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:27:27.391240 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-6ac01d25-4989-4a44-bdfe-e99bcbac6d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:27.399098 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 560/1112] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:27:27 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:27:27.403929 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecce3a-645e-4ea2-80b7-a22789d1c4c6 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:27.413600 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ecce3a-645e-4ea2-80b7-a22789d1c4c6 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:27.418700 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a72a4-c614-4ce1-a0d6-e6f4658cdb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:27.419311 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a72a4-c614-4ce1-a0d6-e6f4658cdb09 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:27.419597 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a72a4-c614-4ce1-a0d6-e6f4658cdb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:27.419874 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a72a4-c614-4ce1-a0d6-e6f4658cdb09 admin admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:27.420597 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a72a4-c614-4ce1-a0d6-e6f4658cdb09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:27:27.420905 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a72a4-c614-4ce1-a0d6-e6f4658cdb09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:27.421909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-869a72a4-c614-4ce1-a0d6-e6f4658cdb09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:27.421909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 26 15:27:27.421909 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: Jul 26 15:27:27.422827 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a72a4-c614-4ce1-a0d6-e6f4658cdb09 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:27.434852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 553/1113] 10.222.0.100 () {58 vars in 1158 bytes} [Tue Jul 26 15:27:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:27:27.443122 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac01d25-4989-4a44-bdfe-e99bcbac6d6d None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:27.452683 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac01d25-4989-4a44-bdfe-e99bcbac6d6d None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:27.457889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb7979-55d1-45c1-b1e6-093248a234e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:27.458531 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb7979-55d1-45c1-b1e6-093248a234e1 admin admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:27.458813 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb7979-55d1-45c1-b1e6-093248a234e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:27.459085 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb7979-55d1-45c1-b1e6-093248a234e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:27.459752 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb7979-55d1-45c1-b1e6-093248a234e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:27.461566 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: WARNING py.warnings [None req-93cb7979-55d1-45c1-b1e6-093248a234e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:27.461566 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: warnings.warn(msg) Jul 26 15:27:27.461566 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: Jul 26 15:27:27.462779 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb7979-55d1-45c1-b1e6-093248a234e1 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:27.603369 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 561/1114] 10.222.0.100 () {60 vars in 1158 bytes} [Tue Jul 26 15:27:27 2022] POST /identity/v3/projects => generated 380 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:27:27.606214 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a72a4-c614-4ce1-a0d6-e6f4658cdb09 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:27.616319 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a72a4-c614-4ce1-a0d6-e6f4658cdb09 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:27.672680 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70eb208-0fcf-4aa3-a28e-8730ecb8ac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:27.673321 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70eb208-0fcf-4aa3-a28e-8730ecb8ac91 admin admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:27.673600 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70eb208-0fcf-4aa3-a28e-8730ecb8ac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:27.674140 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70eb208-0fcf-4aa3-a28e-8730ecb8ac91 admin admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:27.674793 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70eb208-0fcf-4aa3-a28e-8730ecb8ac91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:27.675785 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-b70eb208-0fcf-4aa3-a28e-8730ecb8ac91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:27.675785 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 26 15:27:27.675785 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: Jul 26 15:27:27.677014 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70eb208-0fcf-4aa3-a28e-8730ecb8ac91 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:27.807063 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 554/1115] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:27:27 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:27:27.811776 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb7979-55d1-45c1-b1e6-093248a234e1 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:27.822006 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb7979-55d1-45c1-b1e6-093248a234e1 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:27.827173 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564575bc-b4cd-4a53-860c-73abfda5de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:27.827782 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564575bc-b4cd-4a53-860c-73abfda5de0a admin admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:27.828243 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564575bc-b4cd-4a53-860c-73abfda5de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:27.833966 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564575bc-b4cd-4a53-860c-73abfda5de0a admin admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:27.833966 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564575bc-b4cd-4a53-860c-73abfda5de0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:27.833966 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: WARNING py.warnings [None req-564575bc-b4cd-4a53-860c-73abfda5de0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:27.833966 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: warnings.warn(msg) Jul 26 15:27:27.833966 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: Jul 26 15:27:27.833966 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564575bc-b4cd-4a53-860c-73abfda5de0a admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:27.845471 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 562/1116] 10.222.0.100 () {58 vars in 1127 bytes} [Tue Jul 26 15:27:27 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:27:27.849459 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70eb208-0fcf-4aa3-a28e-8730ecb8ac91 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:27.859725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70eb208-0fcf-4aa3-a28e-8730ecb8ac91 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:27.864411 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3c993-bc15-4502-b841-4c746d9a98c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:27.865018 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c993-bc15-4502-b841-4c746d9a98c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:27.865300 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c993-bc15-4502-b841-4c746d9a98c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:27.865578 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3c993-bc15-4502-b841-4c746d9a98c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:27.866268 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c993-bc15-4502-b841-4c746d9a98c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:27.867282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-d4f3c993-bc15-4502-b841-4c746d9a98c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:27.867282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 26 15:27:27.867282 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: Jul 26 15:27:27.868265 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3c993-bc15-4502-b841-4c746d9a98c2 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:27.882481 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 555/1117] 10.222.0.100 () {58 vars in 1127 bytes} [Tue Jul 26 15:27:27 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:27:27.887368 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564575bc-b4cd-4a53-860c-73abfda5de0a admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:27.897383 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564575bc-b4cd-4a53-860c-73abfda5de0a admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:27.902396 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4d149-7c04-4859-9972-bd8f6fb805b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:27.903064 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d149-7c04-4859-9972-bd8f6fb805b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:27.903353 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d149-7c04-4859-9972-bd8f6fb805b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:27.903630 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4d149-7c04-4859-9972-bd8f6fb805b4 admin admin] PATH_INFO: `/v3/projects/6ff7f3b73d4049bcb6039f597a0205af/users/03867f61b0174761a93a1c8789c6f54c/roles/7b33619ed33f41c0b797124afa4a385d` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:27.918607 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d149-7c04-4859-9972-bd8f6fb805b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff7f3b73d4049bcb6039f597a0205af, user_id=03867f61b0174761a93a1c8789c6f54c, role_id=7b33619ed33f41c0b797124afa4a385d)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:27.921224 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: WARNING py.warnings [None req-e0c4d149-7c04-4859-9972-bd8f6fb805b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:27.921224 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: warnings.warn(msg) Jul 26 15:27:27.921224 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: Jul 26 15:27:27.921712 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4d149-7c04-4859-9972-bd8f6fb805b4 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:28.019708 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 563/1118] 10.222.0.100 () {60 vars in 1488 bytes} [Tue Jul 26 15:27:27 2022] PUT /identity/v3/projects/6ff7f3b73d4049bcb6039f597a0205af/users/03867f61b0174761a93a1c8789c6f54c/roles/7b33619ed33f41c0b797124afa4a385d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:27:28.039235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e53a-229c-42ac-ac8c-6b79032c3c8e None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:28.039531 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e53a-229c-42ac-ac8c-6b79032c3c8e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:28.039779 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27e53a-229c-42ac-ac8c-6b79032c3c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:28.072786 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-9c27e53a-229c-42ac-ac8c-6b79032c3c8e None None] MFA Rules not processed for user `03867f61b0174761a93a1c8789c6f54c`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:27:28.075552 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9c27e53a-229c-42ac-ac8c-6b79032c3c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:28.140652 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 556/1119] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:27:28 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:27:28.154658 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b66ef6-10e9-43d2-84af-d7174e7ff52d None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:28.155064 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b66ef6-10e9-43d2-84af-d7174e7ff52d None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:28.155341 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b66ef6-10e9-43d2-84af-d7174e7ff52d None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:28.157040 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 564/1120] 10.222.0.100 () {54 vars in 969 bytes} [Tue Jul 26 15:27:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:27:28.161941 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f88d81-5ee5-4356-84b6-fb72f41bf5f7 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:28.162230 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f88d81-5ee5-4356-84b6-fb72f41bf5f7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:28.162506 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f88d81-5ee5-4356-84b6-fb72f41bf5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:28.181653 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-00f88d81-5ee5-4356-84b6-fb72f41bf5f7 None None] MFA Rules not processed for user `c5e22a12ebdd493c8c14cfaf2dfc1af2`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:27:28.182858 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-00f88d81-5ee5-4356-84b6-fb72f41bf5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:28.225438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:28.232681 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 557/1121] 10.222.0.100 () {58 vars in 1066 bytes} [Tue Jul 26 15:27:28 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:27:28.240471 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b66ef6-10e9-43d2-84af-d7174e7ff52d None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:28.251323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b66ef6-10e9-43d2-84af-d7174e7ff52d None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:28.255079 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0ae6c-2a70-410b-a756-ccf146c83858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5e22a12ebdd493c8c14cfaf2dfc1af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:28.255673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0ae6c-2a70-410b-a756-ccf146c83858 service cinder] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:28.255953 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0ae6c-2a70-410b-a756-ccf146c83858 service cinder] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:28.256297 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0ae6c-2a70-410b-a756-ccf146c83858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:28.266128 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0ae6c-2a70-410b-a756-ccf146c83858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:28.267548 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0ae6c-2a70-410b-a756-ccf146c83858 service cinder] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:28.277994 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 565/1122] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:27:28 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:27:28.315928 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f00cb-53fb-4cd6-8338-92f6db3d76ef None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:28.316256 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f00cb-53fb-4cd6-8338-92f6db3d76ef None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:28.316533 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f00cb-53fb-4cd6-8338-92f6db3d76ef None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:28.317838 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 558/1123] 10.222.0.100 () {52 vars in 835 bytes} [Tue Jul 26 15:27:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:27:28.321301 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0ae6c-2a70-410b-a756-ccf146c83858 service cinder] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:28.392688 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0ae6c-2a70-410b-a756-ccf146c83858 service cinder] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:28.397194 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:28.397828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:28.398111 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:28.398401 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] PATH_INFO: `/v3/users/03867f61b0174761a93a1c8789c6f54c` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:28.399555 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03867f61b0174761a93a1c8789c6f54c)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:28.400921 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: WARNING py.warnings [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:28.400921 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: warnings.warn(msg) Jul 26 15:27:28.400921 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: Jul 26 15:27:28.402126 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:28.647882 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03867f61b0174761a93a1c8789c6f54c'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:28.661328 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03867f61b0174761a93a1c8789c6f54c'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:28.662087 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03867f61b0174761a93a1c8789c6f54c'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:28.681066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03867f61b0174761a93a1c8789c6f54c'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:28.687216 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:28.793804 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03867f61b0174761a93a1c8789c6f54c'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:28.800327 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 566/1124] 10.222.0.100 () {58 vars in 1229 bytes} [Tue Jul 26 15:27:28 2022] DELETE /identity/v3/users/03867f61b0174761a93a1c8789c6f54c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:27:28.804765 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe782a1-4629-4825-abfb-1d6f6b611d85 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:28.805281 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe782a1-4629-4825-abfb-1d6f6b611d85 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:28.805399 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe782a1-4629-4825-abfb-1d6f6b611d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:28.824657 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-9fe782a1-4629-4825-abfb-1d6f6b611d85 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:27:28.825853 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9fe782a1-4629-4825-abfb-1d6f6b611d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:28.884715 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 559/1125] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:27:28 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:27:28.894281 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:28.895699 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:28.955094 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ba2df-0874-4e61-ae38-0b224e5e9335 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:28.958702 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c05a-4043-4c8e-b44e-9d164d8777b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:28.959315 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c05a-4043-4c8e-b44e-9d164d8777b9 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:28.959598 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c05a-4043-4c8e-b44e-9d164d8777b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:28.959873 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c05a-4043-4c8e-b44e-9d164d8777b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:28.968989 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c05a-4043-4c8e-b44e-9d164d8777b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:28.970426 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c05a-4043-4c8e-b44e-9d164d8777b9 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:28.980437 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 567/1126] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:27:28 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:27:29.471127 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe782a1-4629-4825-abfb-1d6f6b611d85 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:27:29.472765 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9fe782a1-4629-4825-abfb-1d6f6b611d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:27:29.485939 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe782a1-4629-4825-abfb-1d6f6b611d85 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:27:29.491189 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:27:29.492052 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:27:29.492415 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:27:29.492755 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] PATH_INFO: `/v3/projects/6ff7f3b73d4049bcb6039f597a0205af` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:27:29.494067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff7f3b73d4049bcb6039f597a0205af)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:27:29.495871 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:27:29.495871 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 26 15:27:29.495871 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: Jul 26 15:27:29.497270 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:27:29.611075 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff7f3b73d4049bcb6039f597a0205af', 'request_id': 'req-451b9898-ccca-440a-91ed-821264e438e2'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:29.624684 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff7f3b73d4049bcb6039f597a0205af', 'request_id': 'req-451b9898-ccca-440a-91ed-821264e438e2'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:29.630644 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff7f3b73d4049bcb6039f597a0205af', 'request_id': 'req-451b9898-ccca-440a-91ed-821264e438e2'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:29.706984 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] The token cache is being invalidate because project 6ff7f3b73d4049bcb6039f597a0205af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:27:29.711534 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:29.711534 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-451b9898-ccca-440a-91ed-821264e438e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:27:29.711534 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 560/1127] 10.222.0.100 () {58 vars in 1238 bytes} [Tue Jul 26 15:27:29 2022] DELETE /identity/v3/projects/6ff7f3b73d4049bcb6039f597a0205af => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:27:38.975735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:39.703827 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:59.259594 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd6e9-7141-48e2-8610-a118cd1105b7 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:59.260280 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd6e9-7141-48e2-8610-a118cd1105b7 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:59.260280 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edd6e9-7141-48e2-8610-a118cd1105b7 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:59.261498 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 568/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:28:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:28:59.266415 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a8ae6-6a03-4b7b-a601-c38920a69f29 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:59.266843 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a8ae6-6a03-4b7b-a601-c38920a69f29 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:59.266979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a8ae6-6a03-4b7b-a601-c38920a69f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:59.287672 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-df5a8ae6-6a03-4b7b-a601-c38920a69f29 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:28:59.288920 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-df5a8ae6-6a03-4b7b-a601-c38920a69f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:59.345538 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 561/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:28:59 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:28:59.505634 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd6e9-7141-48e2-8610-a118cd1105b7 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:28:59.507321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-49edd6e9-7141-48e2-8610-a118cd1105b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:28:59.577818 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edd6e9-7141-48e2-8610-a118cd1105b7 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:28:59.583375 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842169d8-28db-4fca-bfab-89bf620d6431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:28:59.583996 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842169d8-28db-4fca-bfab-89bf620d6431 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:28:59.584312 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842169d8-28db-4fca-bfab-89bf620d6431 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:28:59.584595 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842169d8-28db-4fca-bfab-89bf620d6431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:28:59.592938 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842169d8-28db-4fca-bfab-89bf620d6431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:28:59.594552 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842169d8-28db-4fca-bfab-89bf620d6431 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:28:59.604075 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 569/1130] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:28:59 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:00.453746 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eab7f-e96c-423e-ad04-d7e652cf3f26 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:00.454313 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eab7f-e96c-423e-ad04-d7e652cf3f26 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:00.454313 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eab7f-e96c-423e-ad04-d7e652cf3f26 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:00.455677 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 562/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:29:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:29:00.460939 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8fb44-8aee-4dd3-ad6f-c7cec67f149a None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:00.461387 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8fb44-8aee-4dd3-ad6f-c7cec67f149a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:00.461387 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8fb44-8aee-4dd3-ad6f-c7cec67f149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:00.481165 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-eac8fb44-8aee-4dd3-ad6f-c7cec67f149a None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:00.482365 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-eac8fb44-8aee-4dd3-ad6f-c7cec67f149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:00.490929 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 570/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:29:00 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:00.647954 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eab7f-e96c-423e-ad04-d7e652cf3f26 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:00.661977 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eab7f-e96c-423e-ad04-d7e652cf3f26 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:00.666871 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8d78c-3c2a-41ad-83ab-906eaa131883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:00.667444 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8d78c-3c2a-41ad-83ab-906eaa131883 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:00.667725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8d78c-3c2a-41ad-83ab-906eaa131883 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:00.667997 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8d78c-3c2a-41ad-83ab-906eaa131883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:00.676225 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8d78c-3c2a-41ad-83ab-906eaa131883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:00.677857 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8d78c-3c2a-41ad-83ab-906eaa131883 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:00.687172 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 563/1133] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:29:00 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:05.199699 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d4e4a-7fca-46ce-9579-1c8b706264ed None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:05.200258 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d4e4a-7fca-46ce-9579-1c8b706264ed None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:05.200258 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d4e4a-7fca-46ce-9579-1c8b706264ed None None] PATH_INFO: `/v3` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:05.201569 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 571/1134] 10.222.0.112 () {54 vars in 930 bytes} [Tue Jul 26 15:29:05 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 15:29:05.207748 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eca33-45f2-4944-924f-f3f5394c6b2e None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:05.208208 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eca33-45f2-4944-924f-f3f5394c6b2e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:05.208307 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eca33-45f2-4944-924f-f3f5394c6b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:05.228251 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-847eca33-45f2-4944-924f-f3f5394c6b2e None None] MFA Rules not processed for user `1fdf1646dad14825b7f78ba823af840f`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:05.229440 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-847eca33-45f2-4944-924f-f3f5394c6b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:05.290846 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 564/1135] 10.222.0.112 () {58 vars in 1020 bytes} [Tue Jul 26 15:29:05 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:09.627676 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff04bf-ef03-4620-9b04-f7e24bcfa7d2 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:09.628260 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff04bf-ef03-4620-9b04-f7e24bcfa7d2 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:09.628260 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff04bf-ef03-4620-9b04-f7e24bcfa7d2 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:09.629498 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 572/1136] 10.222.0.100 () {54 vars in 966 bytes} [Tue Jul 26 15:29:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:29:09.634649 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206cd8a-654b-4a84-a182-999408bd12bf None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:09.635077 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206cd8a-654b-4a84-a182-999408bd12bf None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:09.635196 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206cd8a-654b-4a84-a182-999408bd12bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:09.655056 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b206cd8a-654b-4a84-a182-999408bd12bf None None] MFA Rules not processed for user `1fdf1646dad14825b7f78ba823af840f`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:09.661883 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b206cd8a-654b-4a84-a182-999408bd12bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:09.665751 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 565/1137] 10.222.0.100 () {58 vars in 1063 bytes} [Tue Jul 26 15:29:09 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:09.673140 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff04bf-ef03-4620-9b04-f7e24bcfa7d2 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:09.686386 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff04bf-ef03-4620-9b04-f7e24bcfa7d2 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:09.691340 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa99528-d399-49e8-8ea1-2defbb5945e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fdf1646dad14825b7f78ba823af840f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:09.691945 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99528-d399-49e8-8ea1-2defbb5945e8 service placement] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:09.692256 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99528-d399-49e8-8ea1-2defbb5945e8 service placement] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:09.692536 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99528-d399-49e8-8ea1-2defbb5945e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:09.700836 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa99528-d399-49e8-8ea1-2defbb5945e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:09.702476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa99528-d399-49e8-8ea1-2defbb5945e8 service placement] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:09.712846 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 573/1138] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:29:09 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:29:11.922818 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0147dd8-278d-4ff4-a636-febb9b970908 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:11.923358 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0147dd8-278d-4ff4-a636-febb9b970908 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:11.923358 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0147dd8-278d-4ff4-a636-febb9b970908 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:11.924767 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 566/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:29:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:29:11.929524 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9521-d9b7-46e3-8d61-ce4a7c2619d3 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:11.929911 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9521-d9b7-46e3-8d61-ce4a7c2619d3 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:11.930079 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9521-d9b7-46e3-8d61-ce4a7c2619d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:11.949038 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-f08f9521-d9b7-46e3-8d61-ce4a7c2619d3 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:11.950240 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f08f9521-d9b7-46e3-8d61-ce4a7c2619d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:11.958559 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 574/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:29:11 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:12.117869 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0147dd8-278d-4ff4-a636-febb9b970908 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:12.131398 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0147dd8-278d-4ff4-a636-febb9b970908 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:12.136285 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca88fc4-16a2-4c8e-ae52-e3fda84fc59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:12.136879 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88fc4-16a2-4c8e-ae52-e3fda84fc59f service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:12.137155 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88fc4-16a2-4c8e-ae52-e3fda84fc59f service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:12.137426 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca88fc4-16a2-4c8e-ae52-e3fda84fc59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:12.146100 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca88fc4-16a2-4c8e-ae52-e3fda84fc59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:12.147682 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca88fc4-16a2-4c8e-ae52-e3fda84fc59f service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:12.156979 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 567/1141] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:29:12 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:12.978479 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8266e-a95e-4952-86c3-ef4096979e60 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:12.979059 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8266e-a95e-4952-86c3-ef4096979e60 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:12.979184 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8266e-a95e-4952-86c3-ef4096979e60 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:12.980661 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 575/1142] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 15:29:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:29:12.985983 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2b33-07e0-44e0-b3fa-7aa036942092 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:12.986927 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2b33-07e0-44e0-b3fa-7aa036942092 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:12.987061 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2b33-07e0-44e0-b3fa-7aa036942092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:13.011589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b5fa2b33-07e0-44e0-b3fa-7aa036942092 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:13.012842 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b5fa2b33-07e0-44e0-b3fa-7aa036942092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:13.021475 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 568/1143] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 15:29:12 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:13.178639 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8266e-a95e-4952-86c3-ef4096979e60 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:13.191981 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8266e-a95e-4952-86c3-ef4096979e60 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:13.197027 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46162f3-a9ef-4919-90d2-725e26331bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:13.197629 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46162f3-a9ef-4919-90d2-725e26331bc6 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:13.197913 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46162f3-a9ef-4919-90d2-725e26331bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:13.198192 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46162f3-a9ef-4919-90d2-725e26331bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:13.206282 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46162f3-a9ef-4919-90d2-725e26331bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:13.207856 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46162f3-a9ef-4919-90d2-725e26331bc6 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:13.217219 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 576/1144] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:29:13 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:17.453172 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe31ac-22c4-4c7c-a258-2bbc27a05732 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:17.453759 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe31ac-22c4-4c7c-a258-2bbc27a05732 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:17.453759 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe31ac-22c4-4c7c-a258-2bbc27a05732 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:17.455613 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 569/1145] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:29:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:29:17.461088 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f76ca-90ac-4e05-970e-cb62c3eefc1a None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:17.461546 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f76ca-90ac-4e05-970e-cb62c3eefc1a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:17.461757 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f76ca-90ac-4e05-970e-cb62c3eefc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:17.483375 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-d08f76ca-90ac-4e05-970e-cb62c3eefc1a None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:17.484784 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-d08f76ca-90ac-4e05-970e-cb62c3eefc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:17.493363 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 577/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:29:17 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:17.532403 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe31ac-22c4-4c7c-a258-2bbc27a05732 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:17.534128 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9efe31ac-22c4-4c7c-a258-2bbc27a05732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:17.592485 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe31ac-22c4-4c7c-a258-2bbc27a05732 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:17.596071 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9571af8-26fa-4497-9876-3f9b80f7baa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:17.596708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9571af8-26fa-4497-9876-3f9b80f7baa6 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:17.596989 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9571af8-26fa-4497-9876-3f9b80f7baa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:17.597264 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9571af8-26fa-4497-9876-3f9b80f7baa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:17.606968 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9571af8-26fa-4497-9876-3f9b80f7baa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:17.608438 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9571af8-26fa-4497-9876-3f9b80f7baa6 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:17.613338 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=100 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:17.618362 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 570/1147] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:29:17 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:19.845140 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6ce0-34c3-4d67-964f-3ff09f17b61c None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:19.845688 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6ce0-34c3-4d67-964f-3ff09f17b61c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:19.845688 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac6ce0-34c3-4d67-964f-3ff09f17b61c None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:19.847113 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 578/1148] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:29:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:29:19.852368 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280537db-cd9f-42f7-af4e-aaea84af9f70 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:19.852816 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280537db-cd9f-42f7-af4e-aaea84af9f70 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:19.852977 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280537db-cd9f-42f7-af4e-aaea84af9f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:19.872022 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-280537db-cd9f-42f7-af4e-aaea84af9f70 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:19.873263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-280537db-cd9f-42f7-af4e-aaea84af9f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:19.881710 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 571/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:29:19 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:19.919380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac6ce0-34c3-4d67-964f-3ff09f17b61c None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:19.930108 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac6ce0-34c3-4d67-964f-3ff09f17b61c None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:19.933531 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78424243-b0f8-4528-bf38-cec4100f23c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:19.934123 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78424243-b0f8-4528-bf38-cec4100f23c8 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:19.934403 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78424243-b0f8-4528-bf38-cec4100f23c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:19.934677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78424243-b0f8-4528-bf38-cec4100f23c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:19.944367 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78424243-b0f8-4528-bf38-cec4100f23c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:19.947329 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78424243-b0f8-4528-bf38-cec4100f23c8 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:19.957844 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 579/1150] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:29:19 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:23.953673 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf02dca-808a-4f7e-a8c4-db7a58171700 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:23.954202 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf02dca-808a-4f7e-a8c4-db7a58171700 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:23.954202 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf02dca-808a-4f7e-a8c4-db7a58171700 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:23.956135 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 572/1151] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:29:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:29:23.961557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dbf96-cad3-4564-8214-fcb57be74e73 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:23.961960 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dbf96-cad3-4564-8214-fcb57be74e73 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:23.962118 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dbf96-cad3-4564-8214-fcb57be74e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:23.982138 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-b02dbf96-cad3-4564-8214-fcb57be74e73 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:23.983342 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-b02dbf96-cad3-4564-8214-fcb57be74e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:23.991609 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 580/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:29:23 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:24.269681 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf02dca-808a-4f7e-a8c4-db7a58171700 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:24.271512 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-baf02dca-808a-4f7e-a8c4-db7a58171700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:24.328615 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf02dca-808a-4f7e-a8c4-db7a58171700 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:24.332216 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff72bf-81eb-41f5-bc3e-5e20a67cf678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5e22a12ebdd493c8c14cfaf2dfc1af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:24.332890 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff72bf-81eb-41f5-bc3e-5e20a67cf678 service cinder] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:24.333174 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff72bf-81eb-41f5-bc3e-5e20a67cf678 service cinder] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:24.333452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff72bf-81eb-41f5-bc3e-5e20a67cf678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:24.342250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff72bf-81eb-41f5-bc3e-5e20a67cf678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:24.343670 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff72bf-81eb-41f5-bc3e-5e20a67cf678 service cinder] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:24.353426 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 573/1153] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:29:24 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:26.632934 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6d39-5c05-44ac-9c2a-2cbb12dd3bef None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:26.633537 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6d39-5c05-44ac-9c2a-2cbb12dd3bef None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:26.633537 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b6d39-5c05-44ac-9c2a-2cbb12dd3bef None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:26.634822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 581/1154] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 15:29:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:29:26.640049 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e98e5-a340-41b7-b0fa-f1ec71d5a7f7 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:26.640479 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e98e5-a340-41b7-b0fa-f1ec71d5a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:26.640629 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e98e5-a340-41b7-b0fa-f1ec71d5a7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:26.660208 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-fa6e98e5-a340-41b7-b0fa-f1ec71d5a7f7 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:29:26.661584 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-fa6e98e5-a340-41b7-b0fa-f1ec71d5a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:26.669254 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 574/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 15:29:26 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:29:26.947626 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b6d39-5c05-44ac-9c2a-2cbb12dd3bef None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:29:26.949319 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-f85b6d39-5c05-44ac-9c2a-2cbb12dd3bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:29:26.963020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b6d39-5c05-44ac-9c2a-2cbb12dd3bef None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:29:26.966580 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6d74e-078e-4ec6-bd6b-997b0191323d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5e22a12ebdd493c8c14cfaf2dfc1af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:29:26.967184 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6d74e-078e-4ec6-bd6b-997b0191323d service cinder] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:29:26.967467 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6d74e-078e-4ec6-bd6b-997b0191323d service cinder] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:29:26.967743 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6d74e-078e-4ec6-bd6b-997b0191323d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:29:26.977233 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6d74e-078e-4ec6-bd6b-997b0191323d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:29:26.978662 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6d74e-078e-4ec6-bd6b-997b0191323d service cinder] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:29:26.987905 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 582/1156] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:29:26 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:29:36.654574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=32 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:36.983840 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=68 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:48.879744 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92a3c-6c6d-483a-9dd1-5154a1f7a942 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:48.880476 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92a3c-6c6d-483a-9dd1-5154a1f7a942 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:48.880476 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92a3c-6c6d-483a-9dd1-5154a1f7a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:48.888968 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865821b7-b541-4b83-8550-efe106836160 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:48.889446 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865821b7-b541-4b83-8550-efe106836160 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:48.889551 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865821b7-b541-4b83-8550-efe106836160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:48.900449 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b7b92a3c-6c6d-483a-9dd1-5154a1f7a942 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:48.908002 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b7b92a3c-6c6d-483a-9dd1-5154a1f7a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:48.909753 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-865821b7-b541-4b83-8550-efe106836160 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:48.910966 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-865821b7-b541-4b83-8550-efe106836160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:48.916587 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 575/1157] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:30:48 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:48.919102 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 583/1158] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:30:48 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:30:48.924562 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3850b2-dc1f-4143-8867-f23064ebb9bf None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:48.924852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3850b2-dc1f-4143-8867-f23064ebb9bf None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:48.925130 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3850b2-dc1f-4143-8867-f23064ebb9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:48.927172 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8244-5fb8-45f6-ae19-0893b1ec5b8c None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:48.927440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8244-5fb8-45f6-ae19-0893b1ec5b8c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:48.927718 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8244-5fb8-45f6-ae19-0893b1ec5b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:48.944482 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-7f3850b2-dc1f-4143-8867-f23064ebb9bf None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:48.945697 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-7f3850b2-dc1f-4143-8867-f23064ebb9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:48.946714 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-ff3a8244-5fb8-45f6-ae19-0893b1ec5b8c None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:48.947884 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-ff3a8244-5fb8-45f6-ae19-0893b1ec5b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:48.954129 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 576/1159] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:30:48 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:48.956539 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 584/1160] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:30:48 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:30:48.958672 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3850b2-dc1f-4143-8867-f23064ebb9bf None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:48.960814 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a8244-5fb8-45f6-ae19-0893b1ec5b8c None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:48.969164 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3850b2-dc1f-4143-8867-f23064ebb9bf None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:48.970337 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a8244-5fb8-45f6-ae19-0893b1ec5b8c None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:48.973847 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb11cd-112a-4b38-8a5f-15ec6a4f32f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:48.974445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb11cd-112a-4b38-8a5f-15ec6a4f32f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:48.974726 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb11cd-112a-4b38-8a5f-15ec6a4f32f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:48.974936 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3a5b7-ab8d-42d9-bf56-fdfc28b80874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:48.975060 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb11cd-112a-4b38-8a5f-15ec6a4f32f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:48.975522 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3a5b7-ab8d-42d9-bf56-fdfc28b80874 admin admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:48.975676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb11cd-112a-4b38-8a5f-15ec6a4f32f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87489) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:30:48.975805 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3a5b7-ab8d-42d9-bf56-fdfc28b80874 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:48.975983 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb11cd-112a-4b38-8a5f-15ec6a4f32f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:48.976093 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3a5b7-ab8d-42d9-bf56-fdfc28b80874 admin admin] PATH_INFO: `/v3/domains` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:48.976793 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3a5b7-ab8d-42d9-bf56-fdfc28b80874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87488) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 15:30:48.977107 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3a5b7-ab8d-42d9-bf56-fdfc28b80874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:48.977625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb11cd-112a-4b38-8a5f-15ec6a4f32f9 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:48.978127 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: WARNING py.warnings [None req-12e3a5b7-ab8d-42d9-bf56-fdfc28b80874 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:30:48.978127 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: warnings.warn(msg) Jul 26 15:30:48.978127 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: Jul 26 15:30:48.979005 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3a5b7-ab8d-42d9-bf56-fdfc28b80874 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:48.989235 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 577/1161] 10.222.0.100 () {58 vars in 1158 bytes} [Tue Jul 26 15:30:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:30:48.990711 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 585/1162] 10.222.0.100 () {58 vars in 1158 bytes} [Tue Jul 26 15:30:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 15:30:48.997028 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb11cd-112a-4b38-8a5f-15ec6a4f32f9 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:48.998224 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3a5b7-ab8d-42d9-bf56-fdfc28b80874 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.007631 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb11cd-112a-4b38-8a5f-15ec6a4f32f9 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.008467 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3a5b7-ab8d-42d9-bf56-fdfc28b80874 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.012341 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4f7d8-3ad8-43ac-af7b-6c4f1b4577f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.012977 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4f7d8-3ad8-43ac-af7b-6c4f1b4577f2 admin admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.013105 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a57aa-c0d8-4249-a58b-3b81e4bb14e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.013260 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4f7d8-3ad8-43ac-af7b-6c4f1b4577f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.013539 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4f7d8-3ad8-43ac-af7b-6c4f1b4577f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.013703 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a57aa-c0d8-4249-a58b-3b81e4bb14e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.013988 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a57aa-c0d8-4249-a58b-3b81e4bb14e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.014218 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4f7d8-3ad8-43ac-af7b-6c4f1b4577f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.014322 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a57aa-c0d8-4249-a58b-3b81e4bb14e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.015531 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a57aa-c0d8-4249-a58b-3b81e4bb14e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.015796 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-48b4f7d8-3ad8-43ac-af7b-6c4f1b4577f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:30:49.015796 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 26 15:30:49.015796 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: Jul 26 15:30:49.017039 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4f7d8-3ad8-43ac-af7b-6c4f1b4577f2 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.017801 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a57aa-c0d8-4249-a58b-3b81e4bb14e0 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.126005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 578/1163] 10.222.0.100 () {60 vars in 1158 bytes} [Tue Jul 26 15:30:48 2022] POST /identity/v3/projects => generated 378 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:30:49.130277 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4f7d8-3ad8-43ac-af7b-6c4f1b4577f2 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.150312 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 586/1164] 10.222.0.100 () {60 vars in 1158 bytes} [Tue Jul 26 15:30:48 2022] POST /identity/v3/projects => generated 384 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:30:49.156448 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a57aa-c0d8-4249-a58b-3b81e4bb14e0 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.194073 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4f7d8-3ad8-43ac-af7b-6c4f1b4577f2 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.223160 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a57aa-c0d8-4249-a58b-3b81e4bb14e0 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.228385 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9007-df02-46ef-97a2-495780935781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.228999 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9007-df02-46ef-97a2-495780935781 admin admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.229277 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9007-df02-46ef-97a2-495780935781 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.229551 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9007-df02-46ef-97a2-495780935781 admin admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.230217 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a9007-df02-46ef-97a2-495780935781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.231228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: WARNING py.warnings [None req-c24a9007-df02-46ef-97a2-495780935781 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:30:49.231228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: warnings.warn(msg) Jul 26 15:30:49.231228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: Jul 26 15:30:49.232475 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a9007-df02-46ef-97a2-495780935781 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.258373 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575013b-419e-43c5-b3d6-8a8a17b34ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.258992 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575013b-419e-43c5-b3d6-8a8a17b34ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.259268 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575013b-419e-43c5-b3d6-8a8a17b34ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.259537 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575013b-419e-43c5-b3d6-8a8a17b34ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.260233 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575013b-419e-43c5-b3d6-8a8a17b34ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.262141 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575013b-419e-43c5-b3d6-8a8a17b34ba1 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.307065 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 587/1165] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:30:49 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:30:49.310982 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9007-df02-46ef-97a2-495780935781 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.321315 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9007-df02-46ef-97a2-495780935781 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.326228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0a70c-0414-4c88-87ad-3e9b158fb202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.326815 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a70c-0414-4c88-87ad-3e9b158fb202 admin admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.327226 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a70c-0414-4c88-87ad-3e9b158fb202 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.328150 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a70c-0414-4c88-87ad-3e9b158fb202 admin admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.328851 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0a70c-0414-4c88-87ad-3e9b158fb202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.330460 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0a70c-0414-4c88-87ad-3e9b158fb202 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.340638 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 588/1166] 10.222.0.100 () {58 vars in 1127 bytes} [Tue Jul 26 15:30:49 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:30:49.344550 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0a70c-0414-4c88-87ad-3e9b158fb202 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.353972 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0a70c-0414-4c88-87ad-3e9b158fb202 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.359127 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc803a-3bda-41c5-8109-9c69540cd9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.359696 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc803a-3bda-41c5-8109-9c69540cd9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.359977 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc803a-3bda-41c5-8109-9c69540cd9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.360280 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc803a-3bda-41c5-8109-9c69540cd9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.360943 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc803a-3bda-41c5-8109-9c69540cd9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.362509 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc803a-3bda-41c5-8109-9c69540cd9f6 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.366021 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 579/1167] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:30:49 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:30:49.370952 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575013b-419e-43c5-b3d6-8a8a17b34ba1 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.376809 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 589/1168] 10.222.0.100 () {58 vars in 1127 bytes} [Tue Jul 26 15:30:49 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 15:30:49.377840 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc803a-3bda-41c5-8109-9c69540cd9f6 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.381955 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575013b-419e-43c5-b3d6-8a8a17b34ba1 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.386550 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d579346-5ebc-41d4-8b64-0e944f0b3fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.387154 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d579346-5ebc-41d4-8b64-0e944f0b3fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.387437 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d579346-5ebc-41d4-8b64-0e944f0b3fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.387715 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d579346-5ebc-41d4-8b64-0e944f0b3fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.387976 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc803a-3bda-41c5-8109-9c69540cd9f6 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.388425 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d579346-5ebc-41d4-8b64-0e944f0b3fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.390052 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d579346-5ebc-41d4-8b64-0e944f0b3fe8 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.393145 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63978d9b-8205-4081-a97d-c36ab591410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.393832 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63978d9b-8205-4081-a97d-c36ab591410c admin admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.394117 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63978d9b-8205-4081-a97d-c36ab591410c admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.394396 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63978d9b-8205-4081-a97d-c36ab591410c admin admin] PATH_INFO: `/v3/projects/d4da4dc378b74814bd41fb6eee5e8f8e/users/546d8232dde14722b39aef96f36a78d1/roles/7b33619ed33f41c0b797124afa4a385d` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.400237 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 580/1169] 10.222.0.100 () {58 vars in 1127 bytes} [Tue Jul 26 15:30:49 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:49.404190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d579346-5ebc-41d4-8b64-0e944f0b3fe8 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.411141 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63978d9b-8205-4081-a97d-c36ab591410c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4da4dc378b74814bd41fb6eee5e8f8e, user_id=546d8232dde14722b39aef96f36a78d1, role_id=7b33619ed33f41c0b797124afa4a385d)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.413911 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63978d9b-8205-4081-a97d-c36ab591410c admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.414077 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d579346-5ebc-41d4-8b64-0e944f0b3fe8 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.418591 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8afe40-b298-4550-bba2-6d83660407cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.419190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8afe40-b298-4550-bba2-6d83660407cc admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.419474 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8afe40-b298-4550-bba2-6d83660407cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.419750 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8afe40-b298-4550-bba2-6d83660407cc admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.420467 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8afe40-b298-4550-bba2-6d83660407cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.422587 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8afe40-b298-4550-bba2-6d83660407cc admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.433076 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 581/1170] 10.222.0.100 () {58 vars in 1127 bytes} [Tue Jul 26 15:30:49 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:49.437841 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8afe40-b298-4550-bba2-6d83660407cc admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.447182 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8afe40-b298-4550-bba2-6d83660407cc admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.451816 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37935e1f-2ab4-432c-b97f-c004db7a3c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.452469 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37935e1f-2ab4-432c-b97f-c004db7a3c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.452752 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37935e1f-2ab4-432c-b97f-c004db7a3c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.453028 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37935e1f-2ab4-432c-b97f-c004db7a3c59 admin admin] PATH_INFO: `/v3/projects/1a92b0c642914c0eb2c5807d67f0813e/users/29bdf7897bfa46be8a7d420b0f450310/roles/7b33619ed33f41c0b797124afa4a385d` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.467022 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37935e1f-2ab4-432c-b97f-c004db7a3c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a92b0c642914c0eb2c5807d67f0813e, user_id=29bdf7897bfa46be8a7d420b0f450310, role_id=7b33619ed33f41c0b797124afa4a385d)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.468030 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: WARNING py.warnings [None req-37935e1f-2ab4-432c-b97f-c004db7a3c59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:30:49.468030 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: warnings.warn(msg) Jul 26 15:30:49.468030 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: Jul 26 15:30:49.469977 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37935e1f-2ab4-432c-b97f-c004db7a3c59 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.490303 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 590/1171] 10.222.0.100 () {60 vars in 1488 bytes} [Tue Jul 26 15:30:49 2022] PUT /identity/v3/projects/d4da4dc378b74814bd41fb6eee5e8f8e/users/546d8232dde14722b39aef96f36a78d1/roles/7b33619ed33f41c0b797124afa4a385d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:30:49.495361 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f91ba1-7f6c-4200-8164-a6b2de68a030 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.495650 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f91ba1-7f6c-4200-8164-a6b2de68a030 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.495950 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f91ba1-7f6c-4200-8164-a6b2de68a030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.565747 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 582/1172] 10.222.0.100 () {60 vars in 1488 bytes} [Tue Jul 26 15:30:49 2022] PUT /identity/v3/projects/1a92b0c642914c0eb2c5807d67f0813e/users/29bdf7897bfa46be8a7d420b0f450310/roles/7b33619ed33f41c0b797124afa4a385d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:30:49.571249 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907d33-d773-46c1-b26c-e35cbc030407 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.571542 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907d33-d773-46c1-b26c-e35cbc030407 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.571817 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907d33-d773-46c1-b26c-e35cbc030407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.579456 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:49.592647 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-e3907d33-d773-46c1-b26c-e35cbc030407 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:49.593933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e3907d33-d773-46c1-b26c-e35cbc030407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:49.654209 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-b2f91ba1-7f6c-4200-8164-a6b2de68a030 None None] MFA Rules not processed for user `181490f42ff9443cbbe22f95fe330067`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:49.655357 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-b2f91ba1-7f6c-4200-8164-a6b2de68a030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:49.657215 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 583/1173] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:30:49 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:30:49.663207 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 591/1174] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:30:49 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:30:49.667716 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907d33-d773-46c1-b26c-e35cbc030407 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.669258 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e3907d33-d773-46c1-b26c-e35cbc030407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:49.673734 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f91ba1-7f6c-4200-8164-a6b2de68a030 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:49.731792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:49.735987 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907d33-d773-46c1-b26c-e35cbc030407 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.736412 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f91ba1-7f6c-4200-8164-a6b2de68a030 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:49.739894 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b3f5b-fbeb-493e-802a-5eef70f5e33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.740180 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe083fb-f0e4-4e06-81a0-07ba0eea1139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:49.740741 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b3f5b-fbeb-493e-802a-5eef70f5e33b service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.740887 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe083fb-f0e4-4e06-81a0-07ba0eea1139 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:49.741027 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b3f5b-fbeb-493e-802a-5eef70f5e33b service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.741156 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe083fb-f0e4-4e06-81a0-07ba0eea1139 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:49.741302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b3f5b-fbeb-493e-802a-5eef70f5e33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.741410 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe083fb-f0e4-4e06-81a0-07ba0eea1139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:49.751114 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe083fb-f0e4-4e06-81a0-07ba0eea1139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.752039 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b3f5b-fbeb-493e-802a-5eef70f5e33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:49.756735 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe083fb-f0e4-4e06-81a0-07ba0eea1139 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.756866 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b3f5b-fbeb-493e-802a-5eef70f5e33b service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:49.762451 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 592/1175] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:30:49 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:30:49.762971 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 584/1176] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:30:49 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:30:55.894971 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9244-56f6-472d-9dd9-aadedbaa30cc None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:55.897802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9244-56f6-472d-9dd9-aadedbaa30cc None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:55.898089 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9244-56f6-472d-9dd9-aadedbaa30cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:55.947957 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-066c9244-56f6-472d-9dd9-aadedbaa30cc None None] MFA Rules not processed for user `29bdf7897bfa46be8a7d420b0f450310`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:55.955253 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-066c9244-56f6-472d-9dd9-aadedbaa30cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:56.036308 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 593/1177] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:30:55 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:56.041112 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b3f5b-fbeb-493e-802a-5eef70f5e33b service neutron] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:56.052078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b3f5b-fbeb-493e-802a-5eef70f5e33b service neutron] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:56.058055 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a60cd-9862-4a0a-9733-099f192f80f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:56.058917 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a60cd-9862-4a0a-9733-099f192f80f4 admin admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:56.061924 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a60cd-9862-4a0a-9733-099f192f80f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:56.061924 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a60cd-9862-4a0a-9733-099f192f80f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:56.061924 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a60cd-9862-4a0a-9733-099f192f80f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:56.063246 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a60cd-9862-4a0a-9733-099f192f80f4 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:56.194067 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 585/1178] 10.222.0.100 () {60 vars in 1158 bytes} [Tue Jul 26 15:30:56 2022] POST /identity/v3/projects => generated 378 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:30:56.197206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c9244-56f6-472d-9dd9-aadedbaa30cc None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:56.221649 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c9244-56f6-472d-9dd9-aadedbaa30cc None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:56.330712 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc32ca3-3a51-487f-85ac-587cb84243c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:56.332053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32ca3-3a51-487f-85ac-587cb84243c5 admin admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:56.332443 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32ca3-3a51-487f-85ac-587cb84243c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:56.332728 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32ca3-3a51-487f-85ac-587cb84243c5 admin admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:56.333414 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc32ca3-3a51-487f-85ac-587cb84243c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:56.336020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc32ca3-3a51-487f-85ac-587cb84243c5 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:56.498626 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 594/1179] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:30:56 2022] POST /identity/v3/users => generated 296 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 15:30:56.502384 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a60cd-9862-4a0a-9733-099f192f80f4 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:56.512774 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a60cd-9862-4a0a-9733-099f192f80f4 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:56.518446 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8617f2-f855-4711-92dd-163adc7dcf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:56.519893 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8617f2-f855-4711-92dd-163adc7dcf15 admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:56.519893 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8617f2-f855-4711-92dd-163adc7dcf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:56.519893 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8617f2-f855-4711-92dd-163adc7dcf15 admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:56.522440 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8617f2-f855-4711-92dd-163adc7dcf15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:56.522440 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8617f2-f855-4711-92dd-163adc7dcf15 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:56.537764 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 586/1180] 10.222.0.100 () {58 vars in 1127 bytes} [Tue Jul 26 15:30:56 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:56.542797 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc32ca3-3a51-487f-85ac-587cb84243c5 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:56.556522 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc32ca3-3a51-487f-85ac-587cb84243c5 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:56.562490 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1911-e619-47b2-b886-d8a0c6ab3b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:56.563525 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1911-e619-47b2-b886-d8a0c6ab3b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:56.564428 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1911-e619-47b2-b886-d8a0c6ab3b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:56.564927 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f1911-e619-47b2-b886-d8a0c6ab3b30 admin admin] PATH_INFO: `/v3/projects/aeaa28a073604ec497be78ba572945a1/users/6ddf7214d6914b73aaf96594d3f6b841/roles/6d23401ca57e47398bf036ea320a7617` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:56.602712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a6aa-2d2d-4992-bdff-d465e7dbaed3 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:56.603360 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a6aa-2d2d-4992-bdff-d465e7dbaed3 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:56.604389 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12a6aa-2d2d-4992-bdff-d465e7dbaed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:56.610436 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f1911-e619-47b2-b886-d8a0c6ab3b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeaa28a073604ec497be78ba572945a1, user_id=6ddf7214d6914b73aaf96594d3f6b841, role_id=6d23401ca57e47398bf036ea320a7617)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:56.615718 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f1911-e619-47b2-b886-d8a0c6ab3b30 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:56.640670 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-7e12a6aa-2d2d-4992-bdff-d465e7dbaed3 None None] MFA Rules not processed for user `546d8232dde14722b39aef96f36a78d1`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:30:56.641903 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-7e12a6aa-2d2d-4992-bdff-d465e7dbaed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:30:56.712927 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 587/1181] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:30:56 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:30:56.717141 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12a6aa-2d2d-4992-bdff-d465e7dbaed3 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:56.724516 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:56.727739 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 595/1182] 10.222.0.100 () {60 vars in 1488 bytes} [Tue Jul 26 15:30:56 2022] PUT /identity/v3/projects/aeaa28a073604ec497be78ba572945a1/users/6ddf7214d6914b73aaf96594d3f6b841/roles/6d23401ca57e47398bf036ea320a7617 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:30:56.729024 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12a6aa-2d2d-4992-bdff-d465e7dbaed3 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:56.731737 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1911-e619-47b2-b886-d8a0c6ab3b30 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:56.809633 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:30:56.819397 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0183d6-da42-4d53-948f-3f11441cbb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:56.824945 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0183d6-da42-4d53-948f-3f11441cbb39 admin admin] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:56.825261 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0183d6-da42-4d53-948f-3f11441cbb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:56.825538 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0183d6-da42-4d53-948f-3f11441cbb39 admin admin] PATH_INFO: `/v3/projects` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:56.826679 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0183d6-da42-4d53-948f-3f11441cbb39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:56.829579 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0183d6-da42-4d53-948f-3f11441cbb39 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:56.830187 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f1911-e619-47b2-b886-d8a0c6ab3b30 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:56.838245 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac6e2c-d009-4476-beab-66704ec37499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:56.838989 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac6e2c-d009-4476-beab-66704ec37499 admin admin] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:56.839393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac6e2c-d009-4476-beab-66704ec37499 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:56.839775 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac6e2c-d009-4476-beab-66704ec37499 admin admin] PATH_INFO: `/v3/roles` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:56.840802 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac6e2c-d009-4476-beab-66704ec37499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:56.842587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac6e2c-d009-4476-beab-66704ec37499 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:56.861608 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 596/1183] 10.222.0.100 () {58 vars in 1127 bytes} [Tue Jul 26 15:30:56 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:56.862673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac6e2c-d009-4476-beab-66704ec37499 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:56.876522 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac6e2c-d009-4476-beab-66704ec37499 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:56.883323 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dc14a-1d76-4d7f-96af-ec945ab6949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:56.884076 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dc14a-1d76-4d7f-96af-ec945ab6949b admin admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:56.884231 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dc14a-1d76-4d7f-96af-ec945ab6949b admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:56.884459 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dc14a-1d76-4d7f-96af-ec945ab6949b admin admin] PATH_INFO: `/v3/projects/aeaa28a073604ec497be78ba572945a1/users/6ddf7214d6914b73aaf96594d3f6b841/roles/6d23401ca57e47398bf036ea320a7617` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:56.886438 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29dc14a-1d76-4d7f-96af-ec945ab6949b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeaa28a073604ec497be78ba572945a1, user_id=6ddf7214d6914b73aaf96594d3f6b841, role_id=6d23401ca57e47398bf036ea320a7617)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:56.889197 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29dc14a-1d76-4d7f-96af-ec945ab6949b admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:56.903003 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 597/1184] 10.222.0.100 () {60 vars in 1488 bytes} [Tue Jul 26 15:30:56 2022] PUT /identity/v3/projects/aeaa28a073604ec497be78ba572945a1/users/6ddf7214d6914b73aaf96594d3f6b841/roles/6d23401ca57e47398bf036ea320a7617 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:30:56.961099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 588/1185] 10.222.0.100 () {60 vars in 1158 bytes} [Tue Jul 26 15:30:56 2022] POST /identity/v3/projects => generated 382 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:30:56.965146 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dc14a-1d76-4d7f-96af-ec945ab6949b admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:57.091311 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dc14a-1d76-4d7f-96af-ec945ab6949b admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:57.216548 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc661e-1ff8-488e-a39a-cc953276631f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:57.218822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc661e-1ff8-488e-a39a-cc953276631f admin admin] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:57.218822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc661e-1ff8-488e-a39a-cc953276631f admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:57.218822 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc661e-1ff8-488e-a39a-cc953276631f admin admin] PATH_INFO: `/v3/users` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:57.219135 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc661e-1ff8-488e-a39a-cc953276631f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:57.221645 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc661e-1ff8-488e-a39a-cc953276631f admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:57.325397 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 598/1186] 10.222.0.100 () {60 vars in 1149 bytes} [Tue Jul 26 15:30:56 2022] POST /identity/v3/users => generated 298 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 15:30:57.326938 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0183d6-da42-4d53-948f-3f11441cbb39 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:57.346553 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0183d6-da42-4d53-948f-3f11441cbb39 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:57.367068 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb92ce-9e4c-4e96-9294-d5fee553827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:57.367711 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb92ce-9e4c-4e96-9294-d5fee553827f admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:57.367995 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb92ce-9e4c-4e96-9294-d5fee553827f admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:57.368482 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb92ce-9e4c-4e96-9294-d5fee553827f admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:57.369346 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb92ce-9e4c-4e96-9294-d5fee553827f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:57.371158 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb92ce-9e4c-4e96-9294-d5fee553827f admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:57.387481 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 589/1187] 10.222.0.100 () {58 vars in 1127 bytes} [Tue Jul 26 15:30:57 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:57.388862 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc661e-1ff8-488e-a39a-cc953276631f admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:57.400709 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc661e-1ff8-488e-a39a-cc953276631f admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:57.413345 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4a57d-795b-467f-a00c-edd6efebc75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:57.414170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a57d-795b-467f-a00c-edd6efebc75d admin admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:57.414675 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a57d-795b-467f-a00c-edd6efebc75d admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:57.415152 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a57d-795b-467f-a00c-edd6efebc75d admin admin] PATH_INFO: `/v3/projects/a3b93ef0de104ed2af87979bc8728f3b/users/ca1b8abe285d41218fde693a9e905587/roles/6d23401ca57e47398bf036ea320a7617` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:57.435677 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4a57d-795b-467f-a00c-edd6efebc75d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b93ef0de104ed2af87979bc8728f3b, user_id=ca1b8abe285d41218fde693a9e905587, role_id=6d23401ca57e47398bf036ea320a7617)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:57.439241 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4a57d-795b-467f-a00c-edd6efebc75d admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:57.570474 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 599/1188] 10.222.0.100 () {60 vars in 1488 bytes} [Tue Jul 26 15:30:57 2022] PUT /identity/v3/projects/a3b93ef0de104ed2af87979bc8728f3b/users/ca1b8abe285d41218fde693a9e905587/roles/6d23401ca57e47398bf036ea320a7617 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:30:57.574881 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb92ce-9e4c-4e96-9294-d5fee553827f admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:57.594123 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb92ce-9e4c-4e96-9294-d5fee553827f admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:57.718790 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7de63-2880-4d70-a0d6-9bfe5591db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:57.719443 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7de63-2880-4d70-a0d6-9bfe5591db3a admin admin] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:57.719954 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7de63-2880-4d70-a0d6-9bfe5591db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:57.720073 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7de63-2880-4d70-a0d6-9bfe5591db3a admin admin] PATH_INFO: `/v3/roles` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:57.720759 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7de63-2880-4d70-a0d6-9bfe5591db3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:57.722610 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7de63-2880-4d70-a0d6-9bfe5591db3a admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:57.739441 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 590/1189] 10.222.0.100 () {58 vars in 1127 bytes} [Tue Jul 26 15:30:57 2022] GET /identity/v3/roles => generated 1427 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 15:30:57.743395 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4a57d-795b-467f-a00c-edd6efebc75d admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:30:57.758609 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4a57d-795b-467f-a00c-edd6efebc75d admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:30:57.774934 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce2815-2719-4544-a031-59223a86c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:30:57.775701 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce2815-2719-4544-a031-59223a86c866 admin admin] REQUEST_METHOD: `PUT` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:30:57.775916 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce2815-2719-4544-a031-59223a86c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:30:57.776749 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce2815-2719-4544-a031-59223a86c866 admin admin] PATH_INFO: `/v3/projects/a3b93ef0de104ed2af87979bc8728f3b/users/ca1b8abe285d41218fde693a9e905587/roles/6d23401ca57e47398bf036ea320a7617` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:30:57.779440 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce2815-2719-4544-a031-59223a86c866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b93ef0de104ed2af87979bc8728f3b, user_id=ca1b8abe285d41218fde693a9e905587, role_id=6d23401ca57e47398bf036ea320a7617)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:30:57.782962 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce2815-2719-4544-a031-59223a86c866 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:30:57.799914 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 600/1190] 10.222.0.100 () {60 vars in 1488 bytes} [Tue Jul 26 15:30:57 2022] PUT /identity/v3/projects/a3b93ef0de104ed2af87979bc8728f3b/users/ca1b8abe285d41218fde693a9e905587/roles/6d23401ca57e47398bf036ea320a7617 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:31:03.509146 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca15dc-b855-43c1-bc64-ee89f1df9691 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:03.511032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca15dc-b855-43c1-bc64-ee89f1df9691 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:03.511787 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca15dc-b855-43c1-bc64-ee89f1df9691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:03.557601 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-b1ca15dc-b855-43c1-bc64-ee89f1df9691 None None] MFA Rules not processed for user `6ddf7214d6914b73aaf96594d3f6b841`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:03.558856 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-b1ca15dc-b855-43c1-bc64-ee89f1df9691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:03.649301 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:03.663086 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 591/1191] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:31:03 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:03.679566 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce2815-2719-4544-a031-59223a86c866 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:03.682393 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-e2ce2815-2719-4544-a031-59223a86c866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:03.781092 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:03.834974 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce2815-2719-4544-a031-59223a86c866 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:03.843673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a65fad-7bfd-4843-92cd-33c07381b051 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f62b11cb0dc462caeacfdba8cd45658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:03.843673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a65fad-7bfd-4843-92cd-33c07381b051 service glance] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:03.843673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a65fad-7bfd-4843-92cd-33c07381b051 service glance] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:03.843673 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a65fad-7bfd-4843-92cd-33c07381b051 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:03.965187 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a65fad-7bfd-4843-92cd-33c07381b051 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:03.988031 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a65fad-7bfd-4843-92cd-33c07381b051 service glance] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:04.007527 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 601/1192] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:31:03 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:04.469791 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc3f5-bb42-470b-aff5-5676fc15a0fd None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:04.470081 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc3f5-bb42-470b-aff5-5676fc15a0fd None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:04.470366 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10dc3f5-bb42-470b-aff5-5676fc15a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:04.540798 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-a10dc3f5-bb42-470b-aff5-5676fc15a0fd None None] MFA Rules not processed for user `ca1b8abe285d41218fde693a9e905587`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:04.542657 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-a10dc3f5-bb42-470b-aff5-5676fc15a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:04.697503 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 592/1193] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:31:04 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:04.709983 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a65fad-7bfd-4843-92cd-33c07381b051 service glance] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:04.724037 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a65fad-7bfd-4843-92cd-33c07381b051 service glance] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:04.728839 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5132fa-8319-44c0-aee2-a6928af47a16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f62b11cb0dc462caeacfdba8cd45658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:04.729951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5132fa-8319-44c0-aee2-a6928af47a16 service glance] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:04.730589 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5132fa-8319-44c0-aee2-a6928af47a16 service glance] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:04.732169 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5132fa-8319-44c0-aee2-a6928af47a16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:04.847833 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5132fa-8319-44c0-aee2-a6928af47a16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:04.847833 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5132fa-8319-44c0-aee2-a6928af47a16 service glance] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:04.868304 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 602/1194] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:31:04 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:14.691661 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=35 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:14.861192 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=63 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:15.245037 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182da7a-1726-4e48-9b99-c77215e42bac None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:15.245621 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182da7a-1726-4e48-9b99-c77215e42bac None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:15.251756 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182da7a-1726-4e48-9b99-c77215e42bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:15.276933 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-f182da7a-1726-4e48-9b99-c77215e42bac None None] MFA Rules not processed for user `546d8232dde14722b39aef96f36a78d1`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:15.278516 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-f182da7a-1726-4e48-9b99-c77215e42bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:15.287453 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 593/1195] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:31:15 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:31:15.591185 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31638fc-dab4-473b-809f-55b8da41585c None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:15.595361 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31638fc-dab4-473b-809f-55b8da41585c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:15.595361 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31638fc-dab4-473b-809f-55b8da41585c None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:15.595361 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 603/1196] 10.222.0.100 () {54 vars in 967 bytes} [Tue Jul 26 15:31:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:31:15.599599 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52451a5e-831e-434b-bb68-aa56b0901391 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:15.599878 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52451a5e-831e-434b-bb68-aa56b0901391 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:15.600172 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52451a5e-831e-434b-bb68-aa56b0901391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:15.624254 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-52451a5e-831e-434b-bb68-aa56b0901391 None None] MFA Rules not processed for user `dcc3cee241bd45c49e37124cc4dd6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:15.636630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-52451a5e-831e-434b-bb68-aa56b0901391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:15.695035 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 594/1197] 10.222.0.100 () {58 vars in 1064 bytes} [Tue Jul 26 15:31:15 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:15.700702 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43e4c-ff16-4b5d-98c2-4e5f3d1e1bdb None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:15.701699 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43e4c-ff16-4b5d-98c2-4e5f3d1e1bdb None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:15.702321 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c43e4c-ff16-4b5d-98c2-4e5f3d1e1bdb None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:15.703892 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 604/1198] 10.222.0.100 () {54 vars in 917 bytes} [Tue Jul 26 15:31:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:31:15.708954 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5b39-3ba3-4136-9398-955d6655f2aa None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:15.709250 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5b39-3ba3-4136-9398-955d6655f2aa None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:15.709531 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5b39-3ba3-4136-9398-955d6655f2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:15.733841 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-330d5b39-3ba3-4136-9398-955d6655f2aa None None] MFA Rules not processed for user `dcc3cee241bd45c49e37124cc4dd6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:15.735044 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-330d5b39-3ba3-4136-9398-955d6655f2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:15.745205 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 595/1199] 10.222.0.100 () {58 vars in 1014 bytes} [Tue Jul 26 15:31:15 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:15.757749 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c43e4c-ff16-4b5d-98c2-4e5f3d1e1bdb None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:15.759555 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-35c43e4c-ff16-4b5d-98c2-4e5f3d1e1bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:15.774038 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c43e4c-ff16-4b5d-98c2-4e5f3d1e1bdb None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:15.777585 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853d2c5-fc21-4795-a77e-928e159edac6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f62b11cb0dc462caeacfdba8cd45658', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:15.778194 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853d2c5-fc21-4795-a77e-928e159edac6 service glance] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:15.778475 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853d2c5-fc21-4795-a77e-928e159edac6 service glance] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:15.778753 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853d2c5-fc21-4795-a77e-928e159edac6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:15.789020 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853d2c5-fc21-4795-a77e-928e159edac6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:15.790478 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853d2c5-fc21-4795-a77e-928e159edac6 service glance] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:15.801066 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 605/1200] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:31:15 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:16.164082 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ddae-d0c2-4b83-aa9d-17f652993a5c None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.164445 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ddae-d0c2-4b83-aa9d-17f652993a5c None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.164730 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ddae-d0c2-4b83-aa9d-17f652993a5c None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.166069 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 596/1201] 10.222.0.100 () {54 vars in 917 bytes} [Tue Jul 26 15:31:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:31:16.171276 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c72aae-0d32-4bac-bf51-d3689fd54813 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.171945 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c72aae-0d32-4bac-bf51-d3689fd54813 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.171945 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c72aae-0d32-4bac-bf51-d3689fd54813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.193109 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-b1c72aae-0d32-4bac-bf51-d3689fd54813 None None] MFA Rules not processed for user `50361b26fc1441ea9e78b3f59f1e4f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:16.194539 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-b1c72aae-0d32-4bac-bf51-d3689fd54813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:16.251629 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 606/1202] 10.222.0.100 () {58 vars in 1014 bytes} [Tue Jul 26 15:31:16 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:16.262858 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ddae-d0c2-4b83-aa9d-17f652993a5c None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:16.274423 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ddae-d0c2-4b83-aa9d-17f652993a5c None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:16.278240 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e96c6-a168-41a7-9128-99a2ddae2847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:16.280574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e96c6-a168-41a7-9128-99a2ddae2847 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.280574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e96c6-a168-41a7-9128-99a2ddae2847 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.280574 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e96c6-a168-41a7-9128-99a2ddae2847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.286960 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e96c6-a168-41a7-9128-99a2ddae2847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:16.288424 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e96c6-a168-41a7-9128-99a2ddae2847 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:16.296312 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 597/1203] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:31:16 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:16.806925 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774e22a-383c-47e0-8005-6b238ac79a9d None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.806925 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774e22a-383c-47e0-8005-6b238ac79a9d None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.806925 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774e22a-383c-47e0-8005-6b238ac79a9d None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.806925 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 607/1204] 10.222.0.100 () {54 vars in 967 bytes} [Tue Jul 26 15:31:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:31:16.812582 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c9c4b-257d-449e-b22c-121847a4a853 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.813193 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c9c4b-257d-449e-b22c-121847a4a853 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.813193 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c9c4b-257d-449e-b22c-121847a4a853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.835273 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6001b3-c199-4d61-a081-07f61e9b7665 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.835561 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6001b3-c199-4d61-a081-07f61e9b7665 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.835846 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6001b3-c199-4d61-a081-07f61e9b7665 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.836609 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-5a9c9c4b-257d-449e-b22c-121847a4a853 None None] MFA Rules not processed for user `dcc3cee241bd45c49e37124cc4dd6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:16.837254 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 608/1205] 10.222.0.100 () {54 vars in 966 bytes} [Tue Jul 26 15:31:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:31:16.838099 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-5a9c9c4b-257d-449e-b22c-121847a4a853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:16.842934 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef13f9-a5cd-4784-9de9-f954324a480d None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.843445 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef13f9-a5cd-4784-9de9-f954324a480d None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.844135 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef13f9-a5cd-4784-9de9-f954324a480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.847172 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 598/1206] 10.222.0.100 () {58 vars in 1064 bytes} [Tue Jul 26 15:31:16 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:16.852676 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1963-6e7b-4bdb-b693-176fce3a1828 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.852969 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1963-6e7b-4bdb-b693-176fce3a1828 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.853251 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd1963-6e7b-4bdb-b693-176fce3a1828 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.855201 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 599/1207] 10.222.0.100 () {54 vars in 917 bytes} [Tue Jul 26 15:31:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 26 15:31:16.859516 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35125de-3ff5-41e7-b1e7-817bcdc26c5e None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.859982 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35125de-3ff5-41e7-b1e7-817bcdc26c5e None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.860295 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35125de-3ff5-41e7-b1e7-817bcdc26c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.868154 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-e1ef13f9-a5cd-4784-9de9-f954324a480d None None] MFA Rules not processed for user `1fdf1646dad14825b7f78ba823af840f`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:16.871503 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-e1ef13f9-a5cd-4784-9de9-f954324a480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:16.884908 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-e35125de-3ff5-41e7-b1e7-817bcdc26c5e None None] MFA Rules not processed for user `dcc3cee241bd45c49e37124cc4dd6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:16.886144 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e35125de-3ff5-41e7-b1e7-817bcdc26c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:16.897435 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 600/1208] 10.222.0.100 () {58 vars in 1014 bytes} [Tue Jul 26 15:31:16 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:31:16.908774 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35125de-3ff5-41e7-b1e7-817bcdc26c5e None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:16.917968 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35125de-3ff5-41e7-b1e7-817bcdc26c5e None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:16.921899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783671e-3a9c-4843-aa17-1f5f6b600887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:16.922514 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783671e-3a9c-4843-aa17-1f5f6b600887 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.922806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783671e-3a9c-4843-aa17-1f5f6b600887 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.923091 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783671e-3a9c-4843-aa17-1f5f6b600887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.933579 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783671e-3a9c-4843-aa17-1f5f6b600887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:16.935153 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783671e-3a9c-4843-aa17-1f5f6b600887 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:16.948481 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 601/1209] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:31:16 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:31:16.950019 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 609/1210] 10.222.0.100 () {58 vars in 1063 bytes} [Tue Jul 26 15:31:16 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:31:16.958492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783671e-3a9c-4843-aa17-1f5f6b600887 service neutron] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:16.970379 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783671e-3a9c-4843-aa17-1f5f6b600887 service neutron] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:16.975966 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b625e-a1e8-4890-9634-d7243c6a9796 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fdf1646dad14825b7f78ba823af840f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:16.976618 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b625e-a1e8-4890-9634-d7243c6a9796 service placement] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:16.976925 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b625e-a1e8-4890-9634-d7243c6a9796 service placement] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:16.977200 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b625e-a1e8-4890-9634-d7243c6a9796 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:16.978951 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-a94b625e-a1e8-4890-9634-d7243c6a9796 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:16.991387 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b625e-a1e8-4890-9634-d7243c6a9796 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:16.993083 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b625e-a1e8-4890-9634-d7243c6a9796 service placement] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:17.007078 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 602/1211] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:31:16 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:26.940595 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=58 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:27.001259 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=59 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:29.220188 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028720-aa2d-413d-abd5-5c5d75c3328a None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:29.220188 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028720-aa2d-413d-abd5-5c5d75c3328a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:29.220188 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028720-aa2d-413d-abd5-5c5d75c3328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:29.220188 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-66028720-aa2d-413d-abd5-5c5d75c3328a None None] MFA Rules not processed for user `50361b26fc1441ea9e78b3f59f1e4f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:29.220188 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-66028720-aa2d-413d-abd5-5c5d75c3328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:29.220188 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 610/1212] 10.222.0.112 () {58 vars in 1020 bytes} [Tue Jul 26 15:31:29 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:29.221630 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b625e-a1e8-4890-9634-d7243c6a9796 service placement] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:29.227643 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b625e-a1e8-4890-9634-d7243c6a9796 service placement] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:29.231463 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0691e5-e446-4755-8eec-72b00e3fbc79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:29.232096 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0691e5-e446-4755-8eec-72b00e3fbc79 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:29.232426 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0691e5-e446-4755-8eec-72b00e3fbc79 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:29.232693 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0691e5-e446-4755-8eec-72b00e3fbc79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:29.239827 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0691e5-e446-4755-8eec-72b00e3fbc79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:29.241279 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0691e5-e446-4755-8eec-72b00e3fbc79 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:29.250355 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 603/1213] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:31:29 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:30.070655 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdfb68-73ed-4805-87b4-e48aeb40b9d6 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:30.071798 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdfb68-73ed-4805-87b4-e48aeb40b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:30.072089 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdfb68-73ed-4805-87b4-e48aeb40b9d6 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:30.073496 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 611/1214] 10.222.0.100 () {54 vars in 926 bytes} [Tue Jul 26 15:31:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:31:30.083852 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b255b-44ca-4a15-812e-3d6fb568c0b1 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:30.087077 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b255b-44ca-4a15-812e-3d6fb568c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:30.087077 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b255b-44ca-4a15-812e-3d6fb568c0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:30.120238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-9c8b255b-44ca-4a15-812e-3d6fb568c0b1 None None] MFA Rules not processed for user `dcc3cee241bd45c49e37124cc4dd6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:30.121633 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-9c8b255b-44ca-4a15-812e-3d6fb568c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:30.132591 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 604/1215] 10.222.0.100 () {58 vars in 1023 bytes} [Tue Jul 26 15:31:30 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:30.153355 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdfb68-73ed-4805-87b4-e48aeb40b9d6 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:30.171103 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdfb68-73ed-4805-87b4-e48aeb40b9d6 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:30.177252 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338af1-a295-4f41-a66e-4a8b92f59470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:30.177898 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338af1-a295-4f41-a66e-4a8b92f59470 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:30.178173 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338af1-a295-4f41-a66e-4a8b92f59470 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:30.178451 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338af1-a295-4f41-a66e-4a8b92f59470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:30.195380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b338af1-a295-4f41-a66e-4a8b92f59470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:30.195380 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b338af1-a295-4f41-a66e-4a8b92f59470 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:30.217690 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 612/1216] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:31:30 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:31:37.440243 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e834-9afd-4a2f-a9b1-74c160074f38 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:37.440799 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e834-9afd-4a2f-a9b1-74c160074f38 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:37.440799 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874e834-9afd-4a2f-a9b1-74c160074f38 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:37.442205 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 605/1217] 10.222.0.100 () {54 vars in 926 bytes} [Tue Jul 26 15:31:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:31:37.453687 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a109bd-de91-442e-9975-f86be243c06f None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:37.457295 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a109bd-de91-442e-9975-f86be243c06f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:37.457295 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a109bd-de91-442e-9975-f86be243c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:37.474665 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-b0a109bd-de91-442e-9975-f86be243c06f None None] MFA Rules not processed for user `dcc3cee241bd45c49e37124cc4dd6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:31:37.479672 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-b0a109bd-de91-442e-9975-f86be243c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:31:37.490419 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 613/1218] 10.222.0.100 () {58 vars in 1023 bytes} [Tue Jul 26 15:31:37 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:31:37.503309 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874e834-9afd-4a2f-a9b1-74c160074f38 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:37.521625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874e834-9afd-4a2f-a9b1-74c160074f38 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:37.528329 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61adf237-e5d7-46d1-808a-e38cdb3f60ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:37.529263 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adf237-e5d7-46d1-808a-e38cdb3f60ba service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:37.529545 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adf237-e5d7-46d1-808a-e38cdb3f60ba service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:37.529863 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61adf237-e5d7-46d1-808a-e38cdb3f60ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:37.541527 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adf237-e5d7-46d1-808a-e38cdb3f60ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:37.543021 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61adf237-e5d7-46d1-808a-e38cdb3f60ba service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:37.558314 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 606/1219] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:31:37 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:31:47.470828 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=12 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:47.550986 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=15 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:55.087532 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a109bd-de91-442e-9975-f86be243c06f None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:31:55.097327 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a109bd-de91-442e-9975-f86be243c06f None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:31:55.102400 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c2e11-e7f6-4181-a08b-555155dd6d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:31:55.102400 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c2e11-e7f6-4181-a08b-555155dd6d77 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:31:55.102624 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c2e11-e7f6-4181-a08b-555155dd6d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:31:55.102811 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c2e11-e7f6-4181-a08b-555155dd6d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:31:55.112516 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c2e11-e7f6-4181-a08b-555155dd6d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:31:55.114238 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c2e11-e7f6-4181-a08b-555155dd6d77 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:31:55.126542 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 614/1220] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:31:55 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:01.655580 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1db63-cd67-47dd-a7c9-db6b480a1794 None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:01.656100 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1db63-cd67-47dd-a7c9-db6b480a1794 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:01.656332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1db63-cd67-47dd-a7c9-db6b480a1794 None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:01.657594 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 607/1221] 10.222.0.100 () {54 vars in 926 bytes} [Tue Jul 26 15:32:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:32:01.666170 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e122c-681b-4840-a418-336c21152da3 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:01.667033 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e122c-681b-4840-a418-336c21152da3 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:01.667473 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e122c-681b-4840-a418-336c21152da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:01.702289 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-765e122c-681b-4840-a418-336c21152da3 None None] MFA Rules not processed for user `dcc3cee241bd45c49e37124cc4dd6e34`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:32:01.703557 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-765e122c-681b-4840-a418-336c21152da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:32:01.727315 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 615/1222] 10.222.0.100 () {58 vars in 1023 bytes} [Tue Jul 26 15:32:01 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:32:01.743332 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1db63-cd67-47dd-a7c9-db6b480a1794 None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:32:01.761108 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1db63-cd67-47dd-a7c9-db6b480a1794 None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:32:01.770050 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67e9d9-f10b-4748-8b37-db2a1d365b81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:32:01.770836 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67e9d9-f10b-4748-8b37-db2a1d365b81 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:32:01.771447 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67e9d9-f10b-4748-8b37-db2a1d365b81 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:32:01.775611 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67e9d9-f10b-4748-8b37-db2a1d365b81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:32:01.783712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67e9d9-f10b-4748-8b37-db2a1d365b81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:32:01.790005 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67e9d9-f10b-4748-8b37-db2a1d365b81 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:32:01.807873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 608/1223] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:32:01 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:32:11.688024 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=9 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:32:11.798489 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=6 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:03.870329 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e862a0a-e1c7-4a16-be8e-6a1765846e9f None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:03.870848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e862a0a-e1c7-4a16-be8e-6a1765846e9f None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:03.870939 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e862a0a-e1c7-4a16-be8e-6a1765846e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:03.899659 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-4e862a0a-e1c7-4a16-be8e-6a1765846e9f None None] MFA Rules not processed for user `29bdf7897bfa46be8a7d420b0f450310`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:03.901430 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-4e862a0a-e1c7-4a16-be8e-6a1765846e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:03.927689 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 616/1224] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:33:03 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:13.925623 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=15 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:42.790673 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477292b-986f-4d57-84d8-d74698501a13 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:33:42.791708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477292b-986f-4d57-84d8-d74698501a13 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:33:42.791708 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477292b-986f-4d57-84d8-d74698501a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:33:42.810520 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-6477292b-986f-4d57-84d8-d74698501a13 None None] MFA Rules not processed for user `29bdf7897bfa46be8a7d420b0f450310`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:33:42.811697 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-6477292b-986f-4d57-84d8-d74698501a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:33:42.818452 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 609/1225] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:33:42 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:33:52.805271 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=3 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:00.644339 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd6776-cea8-4bce-a522-01db26983d5a None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:00.644812 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd6776-cea8-4bce-a522-01db26983d5a None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:00.644925 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd6776-cea8-4bce-a522-01db26983d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:00.664275 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-c8bd6776-cea8-4bce-a522-01db26983d5a None None] MFA Rules not processed for user `29bdf7897bfa46be8a7d420b0f450310`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:34:00.666010 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-c8bd6776-cea8-4bce-a522-01db26983d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:00.672848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 617/1226] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:34:00 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:34:01.055111 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641757-2802-4a9c-b16d-1f1a4f5297ca None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:01.055578 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641757-2802-4a9c-b16d-1f1a4f5297ca None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:01.055757 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641757-2802-4a9c-b16d-1f1a4f5297ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:01.123358 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-d4641757-2802-4a9c-b16d-1f1a4f5297ca None None] MFA Rules not processed for user `50361b26fc1441ea9e78b3f59f1e4f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:34:01.124597 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-d4641757-2802-4a9c-b16d-1f1a4f5297ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:34:01.155976 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 610/1227] 10.222.0.100 () {58 vars in 1014 bytes} [Tue Jul 26 15:34:01 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:34:01.168688 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd6776-cea8-4bce-a522-01db26983d5a None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:01.178721 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd6776-cea8-4bce-a522-01db26983d5a None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:01.182874 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4a367-1628-4554-8e5d-bf8a80f11a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:01.184379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4a367-1628-4554-8e5d-bf8a80f11a71 service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:01.184379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4a367-1628-4554-8e5d-bf8a80f11a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:01.184379 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4a367-1628-4554-8e5d-bf8a80f11a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:01.191736 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4a367-1628-4554-8e5d-bf8a80f11a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:01.193243 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4a367-1628-4554-8e5d-bf8a80f11a71 service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:01.201816 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 618/1228] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:34:01 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:34:11.153079 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=33 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:11.197889 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=9 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:34:23.647152 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641757-2802-4a9c-b16d-1f1a4f5297ca None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:34:23.674862 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641757-2802-4a9c-b16d-1f1a4f5297ca None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:34:23.679882 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae3b9-d9af-40d2-ac45-59b7efe4e24a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fdf1646dad14825b7f78ba823af840f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:34:23.680523 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae3b9-d9af-40d2-ac45-59b7efe4e24a service placement] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:34:23.681354 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae3b9-d9af-40d2-ac45-59b7efe4e24a service placement] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:34:23.681629 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae3b9-d9af-40d2-ac45-59b7efe4e24a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:34:23.691873 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae3b9-d9af-40d2-ac45-59b7efe4e24a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:34:23.695625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae3b9-d9af-40d2-ac45-59b7efe4e24a service placement] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:34:23.708888 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 611/1229] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:34:23 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:34:33.705004 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=13 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:24.520864 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2007b10-7cb3-4614-a841-9de07a9e9e2c None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:35:24.521382 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2007b10-7cb3-4614-a841-9de07a9e9e2c None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:35:24.521477 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2007b10-7cb3-4614-a841-9de07a9e9e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:35:24.540446 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-b2007b10-7cb3-4614-a841-9de07a9e9e2c None None] MFA Rules not processed for user `29bdf7897bfa46be8a7d420b0f450310`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:35:24.541632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-b2007b10-7cb3-4614-a841-9de07a9e9e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:35:24.548476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 619/1230] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:35:24 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:35:34.535674 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=3 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:39.995756 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae3b9-d9af-40d2-ac45-59b7efe4e24a service placement] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:35:40.005398 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae3b9-d9af-40d2-ac45-59b7efe4e24a service placement] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:35:40.009602 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12718cc-5766-4508-bb8f-8ae60a19c232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:35:40.010199 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12718cc-5766-4508-bb8f-8ae60a19c232 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:35:40.010498 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12718cc-5766-4508-bb8f-8ae60a19c232 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:35:40.010990 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12718cc-5766-4508-bb8f-8ae60a19c232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:35:40.021967 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12718cc-5766-4508-bb8f-8ae60a19c232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:35:40.023399 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12718cc-5766-4508-bb8f-8ae60a19c232 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:35:40.033830 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 612/1231] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:35:39 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:35:50.028774 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=6 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:35:51.619501 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb27b-9a4e-46bb-b358-a089aa7e5d23 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:35:51.620139 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb27b-9a4e-46bb-b358-a089aa7e5d23 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:35:51.620605 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb27b-9a4e-46bb-b358-a089aa7e5d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:35:51.640351 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-1b3eb27b-9a4e-46bb-b358-a089aa7e5d23 None None] MFA Rules not processed for user `546d8232dde14722b39aef96f36a78d1`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:35:51.647002 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-1b3eb27b-9a4e-46bb-b358-a089aa7e5d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:35:51.649719 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 620/1232] 10.222.0.100 () {58 vars in 963 bytes} [Tue Jul 26 15:35:51 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:36:01.634937 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=3 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:05.321075 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12718cc-5766-4508-bb8f-8ae60a19c232 service neutron] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:36:05.342057 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12718cc-5766-4508-bb8f-8ae60a19c232 service neutron] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:36:05.347229 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da27274-0439-440d-b708-8ffda683b28f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:36:05.347848 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da27274-0439-440d-b708-8ffda683b28f service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:36:05.348165 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da27274-0439-440d-b708-8ffda683b28f service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:36:05.348432 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da27274-0439-440d-b708-8ffda683b28f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:36:05.363459 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da27274-0439-440d-b708-8ffda683b28f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:36:05.363459 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da27274-0439-440d-b708-8ffda683b28f service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:36:05.368797 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 613/1233] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:36:05 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:36:15.363902 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=10 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:17.287154 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eb27b-9a4e-46bb-b358-a089aa7e5d23 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:36:17.352436 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eb27b-9a4e-46bb-b358-a089aa7e5d23 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:36:17.356136 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d33c92-600e-46cd-9977-da6ba3259414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5e22a12ebdd493c8c14cfaf2dfc1af2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:36:17.356774 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d33c92-600e-46cd-9977-da6ba3259414 service cinder] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:36:17.357054 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d33c92-600e-46cd-9977-da6ba3259414 service cinder] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:36:17.357333 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d33c92-600e-46cd-9977-da6ba3259414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:36:17.367848 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d33c92-600e-46cd-9977-da6ba3259414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:36:17.369615 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d33c92-600e-46cd-9977-da6ba3259414 service cinder] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:36:17.381017 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 621/1234] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:36:17 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:36:22.917379 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da27274-0439-440d-b708-8ffda683b28f service nova] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:36:22.917379 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da27274-0439-440d-b708-8ffda683b28f service nova] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:36:22.920343 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8dde1-33ee-4f5a-b6f3-bcc0872ef018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:36:22.920938 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8dde1-33ee-4f5a-b6f3-bcc0872ef018 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:36:22.921222 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8dde1-33ee-4f5a-b6f3-bcc0872ef018 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:36:22.921494 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8dde1-33ee-4f5a-b6f3-bcc0872ef018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:36:22.930754 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8dde1-33ee-4f5a-b6f3-bcc0872ef018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:36:22.932207 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8dde1-33ee-4f5a-b6f3-bcc0872ef018 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:36:22.942473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 614/1235] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:36:22 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:36:27.381451 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=30 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:29.466476 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d33c92-600e-46cd-9977-da6ba3259414 service cinder] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:36:29.475647 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d33c92-600e-46cd-9977-da6ba3259414 service cinder] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:36:29.481928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938984-ad4b-44f3-a526-72e09e74922f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:36:29.482582 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938984-ad4b-44f3-a526-72e09e74922f service neutron] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:36:29.482865 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938984-ad4b-44f3-a526-72e09e74922f service neutron] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:36:29.483134 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938984-ad4b-44f3-a526-72e09e74922f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:36:29.491468 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938984-ad4b-44f3-a526-72e09e74922f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:36:29.493021 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938984-ad4b-44f3-a526-72e09e74922f service neutron] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:36:29.502882 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 622/1236] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:36:29 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:36:32.938014 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=6 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:39.499272 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=6 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:32.805576 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8dde1-33ee-4f5a-b6f3-bcc0872ef018 service neutron] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:32.819772 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8dde1-33ee-4f5a-b6f3-bcc0872ef018 service neutron] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:32.836545 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6f2b0-031c-4ebd-bea4-a12fe1b2e702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:32.837519 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6f2b0-031c-4ebd-bea4-a12fe1b2e702 service nova] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:32.838095 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6f2b0-031c-4ebd-bea4-a12fe1b2e702 service nova] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:32.838457 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6f2b0-031c-4ebd-bea4-a12fe1b2e702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:32.852014 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6f2b0-031c-4ebd-bea4-a12fe1b2e702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:32.855204 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6f2b0-031c-4ebd-bea4-a12fe1b2e702 service nova] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:32.873477 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 615/1237] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:37:32 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:34.368468 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938984-ad4b-44f3-a526-72e09e74922f service neutron] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:34.381965 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938984-ad4b-44f3-a526-72e09e74922f service neutron] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:34.389057 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bcf92-da69-4531-9fb7-163acaa64517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:34.389940 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bcf92-da69-4531-9fb7-163acaa64517 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:34.390611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bcf92-da69-4531-9fb7-163acaa64517 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:34.390611 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bcf92-da69-4531-9fb7-163acaa64517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:34.400475 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bcf92-da69-4531-9fb7-163acaa64517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:34.402092 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bcf92-da69-4531-9fb7-163acaa64517 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:34.415375 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 623/1238] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:37:34 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:42.865228 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=6 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:44.411358 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=6 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:53.825591 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6f2b0-031c-4ebd-bea4-a12fe1b2e702 service nova] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:53.834879 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6f2b0-031c-4ebd-bea4-a12fe1b2e702 service nova] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:53.838501 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e091ed-6b9c-4478-9cd7-e22059853462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:53.839156 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e091ed-6b9c-4478-9cd7-e22059853462 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:53.839435 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e091ed-6b9c-4478-9cd7-e22059853462 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:53.839709 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e091ed-6b9c-4478-9cd7-e22059853462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:53.908631 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e091ed-6b9c-4478-9cd7-e22059853462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:53.910040 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e091ed-6b9c-4478-9cd7-e22059853462 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:53.931625 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 616/1239] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:37:53 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:37:57.877686 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd789bef-62c4-41f9-ab5b-004aea17f7f6 None None] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:57.878214 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd789bef-62c4-41f9-ab5b-004aea17f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:57.878417 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd789bef-62c4-41f9-ab5b-004aea17f7f6 None None] PATH_INFO: `/` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:57.880356 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 624/1240] 10.222.0.100 () {54 vars in 926 bytes} [Tue Jul 26 15:37:57 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:37:57.890377 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0f8ce-8442-4dd0-8696-5fdf5ae5c050 None None] REQUEST_METHOD: `POST` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:57.890902 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0f8ce-8442-4dd0-8696-5fdf5ae5c050 None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:57.891561 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0f8ce-8442-4dd0-8696-5fdf5ae5c050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:57.943996 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.auth.core [None req-75b0f8ce-8442-4dd0-8696-5fdf5ae5c050 None None] MFA Rules not processed for user `1fdf1646dad14825b7f78ba823af840f`. Rule list: `[]` (Enabled: `True`). {{(pid=87489) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:37:57.945249 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-75b0f8ce-8442-4dd0-8696-5fdf5ae5c050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:37:57.953961 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 617/1241] 10.222.0.100 () {58 vars in 1023 bytes} [Tue Jul 26 15:37:57 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 15:37:57.964928 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd789bef-62c4-41f9-ab5b-004aea17f7f6 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:37:57.979967 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd789bef-62c4-41f9-ab5b-004aea17f7f6 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:37:57.985620 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a4ba4-852d-4089-8702-4afbea1bb025 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fdf1646dad14825b7f78ba823af840f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:37:57.986175 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a4ba4-852d-4089-8702-4afbea1bb025 service placement] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:37:57.986459 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a4ba4-852d-4089-8702-4afbea1bb025 service placement] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:37:57.986736 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a4ba4-852d-4089-8702-4afbea1bb025 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:37:57.994996 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a4ba4-852d-4089-8702-4afbea1bb025 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:37:57.996605 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a4ba4-852d-4089-8702-4afbea1bb025 service placement] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:37:58.007143 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 625/1242] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:37:57 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:02.106268 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35714f-1e78-4a25-8926-d1df3cc396bd None None] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:02.106771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35714f-1e78-4a25-8926-d1df3cc396bd None None] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:02.106771 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35714f-1e78-4a25-8926-d1df3cc396bd None None] PATH_INFO: `/` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:02.108386 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 618/1243] 10.222.0.100 () {54 vars in 926 bytes} [Tue Jul 26 15:38:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 26 15:38:02.135223 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc58d-51ef-4964-a443-c8b0712e4938 None None] REQUEST_METHOD: `POST` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:02.137954 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc58d-51ef-4964-a443-c8b0712e4938 None None] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:02.137954 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc58d-51ef-4964-a443-c8b0712e4938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:02.156967 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.auth.core [None req-1ccdc58d-51ef-4964-a443-c8b0712e4938 None None] MFA Rules not processed for user `1fdf1646dad14825b7f78ba823af840f`. Rule list: `[]` (Enabled: `True`). {{(pid=87488) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 15:38:02.158175 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-1ccdc58d-51ef-4964-a443-c8b0712e4938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:02.168206 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 626/1244] 10.222.0.100 () {58 vars in 1023 bytes} [Tue Jul 26 15:38:02 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 15:38:02.179983 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35714f-1e78-4a25-8926-d1df3cc396bd None None] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:02.193486 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35714f-1e78-4a25-8926-d1df3cc396bd None None] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:02.198712 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd196844-942f-405d-8544-f4e9ef08d438 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fdf1646dad14825b7f78ba823af840f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:02.199322 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd196844-942f-405d-8544-f4e9ef08d438 service placement] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:02.199632 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd196844-942f-405d-8544-f4e9ef08d438 service placement] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:02.199904 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd196844-942f-405d-8544-f4e9ef08d438 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:02.209073 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd196844-942f-405d-8544-f4e9ef08d438 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:02.210664 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd196844-942f-405d-8544-f4e9ef08d438 service placement] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:02.220230 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 619/1245] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:38:02 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:38:02.247731 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdc58d-51ef-4964-a443-c8b0712e4938 None None] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:02.264718 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdc58d-51ef-4964-a443-c8b0712e4938 None None] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:02.265270 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:02.266497 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:02.266778 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:02.267053 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] PATH_INFO: `/v3/users/546d8232dde14722b39aef96f36a78d1` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:02.268314 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546d8232dde14722b39aef96f36a78d1)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:02.270546 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:02.593515 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546d8232dde14722b39aef96f36a78d1'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:02.601734 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546d8232dde14722b39aef96f36a78d1'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:02.602541 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546d8232dde14722b39aef96f36a78d1'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:02.617617 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546d8232dde14722b39aef96f36a78d1'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:02.686585 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546d8232dde14722b39aef96f36a78d1'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:02.693493 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 627/1246] 10.222.0.100 () {58 vars in 1229 bytes} [Tue Jul 26 15:38:02 2022] DELETE /identity/v3/users/546d8232dde14722b39aef96f36a78d1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:38:02.966401 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd196844-942f-405d-8544-f4e9ef08d438 service placement] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:02.977407 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd196844-942f-405d-8544-f4e9ef08d438 service placement] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:03.161414 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:03.162072 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:03.162233 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:03.162505 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] PATH_INFO: `/v3/projects/d4da4dc378b74814bd41fb6eee5e8f8e` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:03.163649 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4da4dc378b74814bd41fb6eee5e8f8e)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:03.165589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:03.334369 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:03.343899 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4da4dc378b74814bd41fb6eee5e8f8e', 'request_id': 'req-960dd9cb-1189-4e20-b200-5822a3f338a2'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:03.350415 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4da4dc378b74814bd41fb6eee5e8f8e', 'request_id': 'req-960dd9cb-1189-4e20-b200-5822a3f338a2'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:03.356188 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4da4dc378b74814bd41fb6eee5e8f8e', 'request_id': 'req-960dd9cb-1189-4e20-b200-5822a3f338a2'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:03.474485 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] The token cache is being invalidate because project d4da4dc378b74814bd41fb6eee5e8f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:38:03.474775 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:03.475487 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:03.477056 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 620/1247] 10.222.0.100 () {58 vars in 1238 bytes} [Tue Jul 26 15:38:02 2022] DELETE /identity/v3/projects/d4da4dc378b74814bd41fb6eee5e8f8e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:38:03.481232 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:03.482685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:03.496534 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2f8f0-c6b7-4d78-8844-3037cdb0e0e3 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:03.552913 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:03.553548 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:03.553833 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:03.554114 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] PATH_INFO: `/v3/users/ca1b8abe285d41218fde693a9e905587` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:03.555276 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1b8abe285d41218fde693a9e905587)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:03.557255 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:03.848229 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1b8abe285d41218fde693a9e905587'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:03.853478 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:03.855656 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1b8abe285d41218fde693a9e905587'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:03.856446 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1b8abe285d41218fde693a9e905587'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:03.869030 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1b8abe285d41218fde693a9e905587'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:04.057940 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1b8abe285d41218fde693a9e905587'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:04.064659 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 628/1248] 10.222.0.100 () {58 vars in 1229 bytes} [Tue Jul 26 15:38:03 2022] DELETE /identity/v3/users/ca1b8abe285d41218fde693a9e905587 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:38:04.414609 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:38:04.416033 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:38:04.430435 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dd9cb-1189-4e20-b200-5822a3f338a2 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:38:04.488783 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:38:04.489244 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:38:04.489526 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:38:04.489801 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] PATH_INFO: `/v3/projects/a3b93ef0de104ed2af87979bc8728f3b` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:38:04.490994 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b93ef0de104ed2af87979bc8728f3b)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:38:04.492936 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:38:04.628484 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b93ef0de104ed2af87979bc8728f3b', 'request_id': 'req-3153d513-6e63-412b-97a5-1e24c2de5b74'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:04.635615 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b93ef0de104ed2af87979bc8728f3b', 'request_id': 'req-3153d513-6e63-412b-97a5-1e24c2de5b74'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:04.642065 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b93ef0de104ed2af87979bc8728f3b', 'request_id': 'req-3153d513-6e63-412b-97a5-1e24c2de5b74'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:04.702730 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] The token cache is being invalidate because project a3b93ef0de104ed2af87979bc8728f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:38:04.702943 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:04.704183 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:38:04.705718 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 621/1249] 10.222.0.100 () {58 vars in 1238 bytes} [Tue Jul 26 15:38:04 2022] DELETE /identity/v3/projects/a3b93ef0de104ed2af87979bc8728f3b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:38:14.154696 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=9,keystone:DELETE=3,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:14.699511 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:DELETE=12,keystone:SELECT=67,keystone:INSERT=2 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:09.644495 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:09.648006 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:09.730129 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b310f-7cf2-49b5-af36-87a6014a65e6 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:09.788364 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab212255-4d58-4cd2-8d48-c195980302d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcc3cee241bd45c49e37124cc4dd6e34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:09.788975 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab212255-4d58-4cd2-8d48-c195980302d3 service nova] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:09.789259 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab212255-4d58-4cd2-8d48-c195980302d3 service nova] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:09.789534 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab212255-4d58-4cd2-8d48-c195980302d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:09.791408 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-ab212255-4d58-4cd2-8d48-c195980302d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:09.848946 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab212255-4d58-4cd2-8d48-c195980302d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:09.850542 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab212255-4d58-4cd2-8d48-c195980302d3 service nova] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:09.859459 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 629/1250] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:39:09 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 15:39:19.855432 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=85 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:25.068806 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:25.073238 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:25.126948 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153d513-6e63-412b-97a5-1e24c2de5b74 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:25.130567 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfbfd8-98c4-4171-8733-529f3e7009b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50361b26fc1441ea9e78b3f59f1e4f8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:25.131172 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfbfd8-98c4-4171-8733-529f3e7009b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:25.131450 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfbfd8-98c4-4171-8733-529f3e7009b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:25.131723 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfbfd8-98c4-4171-8733-529f3e7009b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:25.133492 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-80bfbfd8-98c4-4171-8733-529f3e7009b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:25.196667 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfbfd8-98c4-4171-8733-529f3e7009b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:25.198095 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfbfd8-98c4-4171-8733-529f3e7009b6 service neutron] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:25.208658 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 622/1251] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:39:25 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:39:32.501508 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab212255-4d58-4cd2-8d48-c195980302d3 service nova] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:32.503155 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-ab212255-4d58-4cd2-8d48-c195980302d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:32.517039 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab212255-4d58-4cd2-8d48-c195980302d3 service nova] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:32.522051 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:32.522685 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:32.522970 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:32.523244 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] PATH_INFO: `/v3/users/29bdf7897bfa46be8a7d420b0f450310` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:32.524422 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bdf7897bfa46be8a7d420b0f450310)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:32.526391 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:32.722468 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bdf7897bfa46be8a7d420b0f450310'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:32.729278 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bdf7897bfa46be8a7d420b0f450310'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:32.729946 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bdf7897bfa46be8a7d420b0f450310'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:32.743010 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bdf7897bfa46be8a7d420b0f450310'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:32.811885 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bdf7897bfa46be8a7d420b0f450310'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:32.818299 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 630/1252] 10.222.0.100 () {58 vars in 1229 bytes} [Tue Jul 26 15:39:32 2022] DELETE /identity/v3/users/29bdf7897bfa46be8a7d420b0f450310 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:39:33.104991 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfbfd8-98c4-4171-8733-529f3e7009b6 service neutron] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:33.115169 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfbfd8-98c4-4171-8733-529f3e7009b6 service neutron] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:33.178093 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:33.178725 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:33.179032 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:33.179301 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] PATH_INFO: `/v3/projects/1a92b0c642914c0eb2c5807d67f0813e` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:33.180475 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a92b0c642914c0eb2c5807d67f0813e)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:33.182408 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:33.288302 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a92b0c642914c0eb2c5807d67f0813e', 'request_id': 'req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:33.290114 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:33.294495 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a92b0c642914c0eb2c5807d67f0813e', 'request_id': 'req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:33.299924 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a92b0c642914c0eb2c5807d67f0813e', 'request_id': 'req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:33.397344 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] The token cache is being invalidate because project 1a92b0c642914c0eb2c5807d67f0813e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:39:33.397636 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:33.398391 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:33.401009 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 623/1253] 10.222.0.100 () {58 vars in 1238 bytes} [Tue Jul 26 15:39:33 2022] DELETE /identity/v3/projects/1a92b0c642914c0eb2c5807d67f0813e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:39:33.405632 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:33.412800 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:33.422228 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633af1c-6304-4e0e-b725-9139807afc46 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:33.478555 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:33.479197 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:33.479479 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:33.479754 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] PATH_INFO: `/v3/users/6ddf7214d6914b73aaf96594d3f6b841` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:33.480951 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ddf7214d6914b73aaf96594d3f6b841)` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:33.482896 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:33.657711 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ddf7214d6914b73aaf96594d3f6b841'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:33.664792 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ddf7214d6914b73aaf96594d3f6b841'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:33.665475 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ddf7214d6914b73aaf96594d3f6b841'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:33.677271 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ddf7214d6914b73aaf96594d3f6b841'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:33.678911 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:33.760562 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.notifications [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ddf7214d6914b73aaf96594d3f6b841'} {{(pid=87488) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:33.767716 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 631/1254] 10.222.0.100 () {58 vars in 1229 bytes} [Tue Jul 26 15:39:33 2022] DELETE /identity/v3/users/6ddf7214d6914b73aaf96594d3f6b841 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 15:39:34.002320 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] Authenticating user token {{(pid=87489) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:39:34.003957 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.fernet_utils [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87489) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:39:34.017179 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78fa5-2ad0-4e0b-ad61-0d29391d0818 admin admin] Validating token access rules against request {{(pid=87489) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:39:34.074650 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '181490f42ff9443cbbe22f95fe330067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bca50b89fb044b68b53520d35aa1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87489) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:39:34.075283 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:39:34.075589 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:39:34.075963 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] PATH_INFO: `/v3/projects/aeaa28a073604ec497be78ba572945a1` {{(pid=87489) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:39:34.077186 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeaa28a073604ec497be78ba572945a1)` {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:39:34.079605 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] RBAC: Authorization granted {{(pid=87489) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:39:34.190824 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeaa28a073604ec497be78ba572945a1', 'request_id': 'req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:34.197037 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeaa28a073604ec497be78ba572945a1', 'request_id': 'req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:34.202473 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeaa28a073604ec497be78ba572945a1', 'request_id': 'req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6'} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:34.276190 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] The token cache is being invalidate because project aeaa28a073604ec497be78ba572945a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87489) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 15:39:34.276409 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:34.277014 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG keystone.notifications [None req-35a04dbe-90ea-40fc-b028-4f9ada82fdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87489) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 15:39:34.278561 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: [pid: 87489|app: 0|req: 624/1255] 10.222.0.100 () {58 vars in 1238 bytes} [Tue Jul 26 15:39:34 2022] DELETE /identity/v3/projects/aeaa28a073604ec497be78ba572945a1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 15:39:44.088017 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:39:44.273084 dv-osbrick-786732-11-ceph devstack@keystone.service[87489]: DEBUG dbcounter [-] [87489] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87489) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:14.400982 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] Authenticating user token {{(pid=87488) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 15:40:14.402462 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:40:14.472407 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10a003-863a-4b38-8613-08f44d0a2068 admin admin] Validating token access rules against request {{(pid=87488) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 15:40:14.532960 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a526f-5cd2-4a63-8df8-44b5febfa9fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fdf1646dad14825b7f78ba823af840f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7bc4375bb14d42199565b224bef1242c', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87488) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 15:40:14.533587 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a526f-5cd2-4a63-8df8-44b5febfa9fd service placement] REQUEST_METHOD: `GET` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 15:40:14.533872 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a526f-5cd2-4a63-8df8-44b5febfa9fd service placement] SCRIPT_NAME: `/identity` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 15:40:14.534148 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a526f-5cd2-4a63-8df8-44b5febfa9fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87488) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 15:40:14.535946 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.fernet_utils [None req-655a526f-5cd2-4a63-8df8-44b5febfa9fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87488) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 15:40:14.547854 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a526f-5cd2-4a63-8df8-44b5febfa9fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 15:40:14.549607 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a526f-5cd2-4a63-8df8-44b5febfa9fd service placement] RBAC: Authorization granted {{(pid=87488) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 15:40:14.560394 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: [pid: 87488|app: 0|req: 632/1256] 10.222.0.100 () {60 vars in 1370 bytes} [Tue Jul 26 15:40:14 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 15:40:24.556309 dv-osbrick-786732-11-ceph devstack@keystone.service[87488]: DEBUG dbcounter [-] [87488] Writing DB stats keystone:SELECT=58 {{(pid=87488) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}